For the phrase “When you are disturbed, do not sin,” see Ephesians 4:26.
Note that this quote in the New Testament is not taken from the Hebrew Bible but from the Greek Septuagint (LXX) which translates into English as “Be angry, and do not sin.” (Translation by NETS — for the Greek version see the title’s tooltip)