This bet was based on the credibility and know-how demonstrated over time and, currently, the team in place has a total of 40 employees, six of whom are certified in Cloud Azure, as well as four also certified in Cloud AWS
With this commitment, our client has completely abandoned the need to maintain a specialized in-house team, obtaining from Aubay:
Huge confidence in the maintenance of the entire infrastructure, with a dedicated service, 24 hours a day, 7 days a week;
Greater capacity and elasticity in developing specific projects at the same time, with the guarantee of increasing or reducing teams according to needs and in good time;
Extensive knowledge of the 40 or so technical staff involved;
The adoption of innovative and pioneering technologies - as a result of continuous improvement and the path we have followed in constant evolution, Aubay was, through this service, one of the first companies in the world to work with databrick technology, integrated into Google Cloud.
The use of Databricks made it possible to replace the massive use of other cloud components, which resulted in a proportional reduction in human intervention and the costs directly associated with licensing these Microsoft Azure components.
By using Databricks, it was possible to run several data pipelines simultaneously, with much faster availability compared to any other solution on the market. This investment has also made it possible to increase the company's satisfaction rates and recognition with regard to environmental impact, which is essential to its operation. The choice to integrate with Google Cloud came from the development of two new products that would require data, most of which was already in Google's services, Analytics.
The biggest technological difficulty in carrying out an architectural restructuring in this area is the use of platforms/tools that are very new to the market and most of whose functionalities are still in beta. Added to this is the difficulty of making these features available in products in a production environment that are used extensively by end users. These innovations don't always promise greater stability and availability, so monitoring had to be carried out and, of course, after being put into production, we never had a moment's downtime.
Databricks in Google Cloud. This could be a major breakthrough for organizations taking advantage of products which, being still a new technology, may require the use of open source tools or others not developed by Google.
The use of new and innovative technologies allows us to participate in their development, at a very early stage, actively participating in the evolution of the products, in their knowledge base, as well as being able to support the entire community afterwards. Using Databricks with Google Cloud allows us to reuse a lot of the work already done in Azure without any major problems, making it easier to migrate and scale projects more quickly and effectively.
In the case of our client, using Databricks in Azure has led to a very significant reduction in costs and an increase in performance, reducing processing time in some cases by 70%.