Most banks and credit unions have a (free) electronic bill pay integrated into their online banking that allow you to pay bills to the kinds of companies that you listed. The bank typically figures out whether to send them a physical check, or handle it electronically.