It seems the default behavior when you add a show to sonarr is for it to start searching for it right away.
I cant find an option to only add it but not add it monitored.

Is this possible?

Yes, there is another app i found that lets you do that. but i prefer this because in couch potato it actually says if the movie exists already or not. and other apps dont do that