Skip to main content

Future of Machine Learning

· 4 min read
Ross Bulat
Full Stack Engineer

The future of machine learning is not merely a progression towards larger models. It is a search for systems that learn from less supervision, design themselves more efficiently, operate closer to users and remain accountable when their decisions affect society.

Learning with Fewer Labels

Self-supervised learning (SSL) creates training signals from unlabelled data, such as predicting a masked image region or matching two augmented views. A representation can then be fine-tuned with a smaller labelled dataset, reducing expensive annotation in fields such as medical imaging and speech (Ericsson et al., 2022). However, unlabelled does not mean unbiased or lawful. Web, sensor and patient data can contain historical discrimination, personal information and rare cases that a downstream test set misses. SSL may shift expenditure from labelling to large-scale pre-training, so teams must evaluate data provenance, transferability and compute cost rather than assuming it is automatically cheaper.

Automating Model Design

Neural Architecture Search (NAS) automates choices such as layers, connections and operations. It can discover architectures that outperform hand-designed alternatives and optimise for several objectives, including accuracy, latency or memory. Its difficulty is that the search space, search strategy and performance estimation method all influence the result (Elsken, Metzen and Hutter, 2019). Repeatedly training candidates can be computationally and environmentally expensive, while results may be difficult to reproduce. A development team should therefore compare NAS with strong manual baselines and treat energy, hardware constraints and search budget as evaluation metrics.

Intelligence at the Edge

Edge AI runs inference on, or near, the device producing data. This reduces network latency and can keep raw information local: essential advantages for autonomous vehicles, wearable medical devices and smart-city sensors (Zhou et al., 2019). Yet small devices impose limits on memory, battery, cooling and model size. Offline operation also complicates security patches, monitoring and rollback. In safety-critical settings, a fast local prediction is valuable only if uncertainty, sensor failure and human override have been designed into the wider system. In smart cities, local processing can improve privacy but does not resolve questions about surveillance, consent or unequal monitoring.

Responsible and Sustainable Progress

Future scalability should mean useful performance per unit of data, energy and hardware. Professionals need to document carbon-intensive training, compress models carefully, test demographic and environmental subgroups, and monitor behaviour after deployment. Legally, the EU AI Act illustrates a move towards risk-based obligations, transparency and protection of health, safety and fundamental rights (European Parliament and Council of the European Union, 2024).

Within a virtual development team, data engineers should record lineage and consent; ML engineers should report uncertainty, efficiency and subgroup errors; domain experts should define harmful failure modes; security and MLOps specialists should test attacks, drift and recovery; and product or legal colleagues should maintain accountability. Shared model cards, reproducible experiments and explicit release gates make these roles visible.

References

Elsken, T., Metzen, J.H. and Hutter, F. (2019) ‘Neural architecture search: A survey’, Journal of Machine Learning Research, 20(55), pp. 1–21. Available at: https://jmlr.org/papers/v20/18-598.html (Accessed: 12 July 2026).

Ericsson, L., Gouk, H., Loy, C.C. and Hospedales, T.M. (2022) ‘Self-supervised representation learning: Introduction, advances, and challenges’, IEEE Signal Processing Magazine, 39(3), pp. 42–62. Available at: https://doi.org/10.1109/MSP.2021.3134634 (Accessed: 12 July 2026).

European Parliament and Council of the European Union (2024) ‘Regulation (EU) 2024/1689 laying down harmonised rules on artificial intelligence’, Official Journal of the European Union, 12 July. Available at: https://eur-lex.europa.eu/eli/reg/2024/1689/oj/eng (Accessed: 12 July 2026).

Zhou, Z., Chen, X., Li, E., Zeng, L., Luo, K. and Zhang, J. (2019) ‘Edge intelligence: Paving the last mile of artificial intelligence with edge computing’, Proceedings of the IEEE, 107(8), pp. 1738–1762. Available at: https://doi.org/10.1109/JPROC.2019.2918951 (Accessed: 12 July 2026).