AI Training Data Drying Up: Musk Calls For Synthetic Solutions
Musk warns that real-world data for AI training is running out. Synthetic data, generated by AI, is the future. Already used by companies like Microsoft, Meta & OpenAI, with benefits of cost savings but risks of model collapse & bias.
Elon Musk concurs with other AI experts that there’s little real-world data left to train AI models on. “We’ve now exhausted basically the cumulative sum of human knowledge …. in AI training,” Musk said during a livestreamed conversation with Stagwell chairman Mark Penn streamed on X late Wednesday. “That happened basically last year.” Musk, who owns AI company xAI, echoed themes former OpenAI chief scientist Ilya Sutskever touched on at NeurIPS, the machine learning conference, during an address in December. Sutskever, who said the AI industry had reached what he called “peak data,” predicted...