This is the hard bit for most people. To help you change chord easier, I suggest keeping your first finger down and shuffling it between the first and second frets. This is called an anchor finger as it stays in contact with the guitar and should make your changes smoother.
This ‘anchor finger’ idea will also help you to play the next chord (which is a D) as the first finger will not have to move at all to play that one!