Why (and how) I use poetry for python package managementI always remember to write about this when I hear someone in a meeting complaining about some broken package in python.Mar 20, 2021Mar 20, 2021
Pyspark image with jobs syncing through gitAnytime we want to trigger a spark job, we also need to deploy our jar package, or in pyspark case, our zip package to be executed.Jan 27, 2021Jan 27, 2021
Criando e customizando sua imagem pysparkSempre quis uma imagem docker oficial para rodar alguns jobs locais, rodar uns testes e usar para meus projetos.Jan 27, 2021Jan 27, 2021
Creating and customizing your pyspark imageI’ve always wanted an official spark docker to run local jobs, run some tests and prepare to deploy these in my projects.Dec 28, 2020Dec 28, 2020
Published inTech@Grupo ZAPAirflow com Dags em YAML Dags e kubernetes operatorSimplificando a criação de DAGsMay 14, 2020May 14, 2020
Airflow with YAML Dags and kubernetes operatorSimplifying the creation of DAGsApr 28, 2020Apr 28, 2020
Published inTech@Grupo ZAPAirflow escalável com Kubernetes + Git SyncUsando airflow para prover uma solução para múltiplos timesJan 21, 20201Jan 21, 20201
Scalable airflow with Kubernetes + Git SyncA simplified use of airflow to provide a solution for multiple teamsJan 21, 20201Jan 21, 20201
Luigi: Running one task multiples timesI started working with Luigi only a few weeks ago. I understood the basics and felt like trying it in a data warehouse project to link all…Feb 12, 2018Feb 12, 2018