My perspective on Andrej Karpathy's "Software Is Changing (Again)"
The Three Paradigms of Software Karpathy's Framework: Andrej talks about how Software is fundamentally changing for the first time in 70 years, having changed approximately twice in recent years Software 1.0: Traditional code written by humans for computers Software 2.0: Neural network weights (not written directly but tuned through datasets and optimizers) Software 3.0: Prompts in English that program Large Language Models (LLMs) My Perspective: As an engineering practitioner, I see fundamental challenges in "prompt engineering" that threaten its scalability and reliability: Standardization Crisis : Unlike traditional programming languages with formal syntax, natural language prompts suffer from inherent ambiguity. While researchers have identified 26 design principles for prompt engineering, we lack universal standards comparable to programming language specifications. Cross-model and Version Compatibility : Currently, "there is no such thing as prompt po...