In recent developments within the AI landscape, our team has been leveraging distributed systems to train advanced machine learning models over the internet. This innovative approach, named Distributed Training Over-the-Internet (DisTrO), enables the