Observability and monitoring is the most cited challenge when moving ML models into production. The Institute for Ethical AI & Machine Learning conducted a survey on the state of production ML in the fourth quarter of 2024. The other key takeaway is that custom-built tools dominate user roadmaps, since few vendor tools have gained significant traction.
Overall, 44% of the 170 practitioners surveyed were machine learning engineers with about the same amount identifying as a data scientist or a MLOps engineer. Many of the respondents are…