high altitude and high rev

Ok here is the deal. When I go either driving up a mountain or down a mountain. My car begins to rev very high in the low gears and when its in neutral. I was wondering if my short ram intake would cause this or if a broken o2 sensor would cause this. The strange thing is once it gets used to the elevation it will stop revving high.