In short yes, It will affect your website either in a positive or negative manner depends on which site you are linking out too..
If you link out to a harmful malicious site then it will affect you negatively. ( Mostly try not to include such links in your site, In case you cant avoid it make sure you make it nofollow)
A site whos DA is less than yours or is not related to your sites niche has a chance to affect your site a bit. ( Make these links nofollow )
and sites like Wikipedia and other high authority sites are likely to have a positive impact on your site. (Keep these links as dofollow as they are helpful for your site )