If cutting peppers drives you crazy, watch this video and learn how to do it the easy way.
Do not dispose of the top cap, you would risk wasting part of the pepper. Cut it into wedges as you see in the video: separate the sections from the bottom up to the stalk. Now you'll be able to remove the central part with seeds more easily.