New Home With Cat5e Only Wired For Phone

I have CAT5e running through out the house. They all start at a 4x10 telecom punchdown module and end with non standard jacks. When I unscrewed a few wallplates, only the orange, white orange, blue, white blue are connected. The greens and browns are snipped off. I don't much care if I have a telephone or not (my cell phone is my only phone), I'm thinking of pulling all the cat5e off the module and attaching RJ45 plugs on them. Seeing that only the wires I mentioned above are connected at the wallplates, do I need to terminate all the wires on the RJ45 plug or only those four?I'm not planning on going up to a 1gb connection right now because I only have 20mb service anyways. Also, will I still received data only using those four wires?