In this paper, I discuss the technical aspects of the Internet and conclude that there has been little Network Neutrality in the past, is not much in the present, and there probably should not be any more in the future either. I argue that the tension created by differences between competing providers allows them to innovate to solve problems. In particular, I outline some underlying architectural problems with the core Internet Design Philosophy which are now leading to shortcomings in the technology which require a new phase of rapid invention in the narrow Internet Protocol waist of the hourglass model of the Internet Protocol Stack. Without the ability to differentiate, it is hard to see how any progress will be made on solving these shortcomings. I present examples from the past that show that neutrality was never a requirement or a reality in early Internet protocols or deployment, and that examples of innovation in that past might be lessons for motivating evolution of the Internet in the future.