Esse é o meu primeiro repo tratando de fim a fim, uma pipeline de dados abertos do governo brasileiro relacionado a compras de contrato e cronogramas anuais com spark, em pyspark e SQL!
☆10Mar 25, 2022Updated 4 years ago
Alternatives and similar repositories for data_engineer
Users that are interested in data_engineer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This is a pipeline of an ETL application in GCP with open airport code data, which you can find here: https://datahub.io/core/airport-cod…☆18Nov 15, 2021Updated 4 years ago
- Python Projects made for beginner, intermediate and advanced levels. [Portuguese]☆21Jan 31, 2023Updated 3 years ago
- ☆12Mar 15, 2022Updated 4 years ago
- This is an ETL application on AWS with general open sales and customer data that you can find here: https://github.com/camposvinicius/dat…☆23Feb 7, 2022Updated 4 years ago
- Solve Captcha Receita Federal - Brasileira - Consulta CNPJ☆14Jun 3, 2022Updated 4 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- This repository creates the following resources on AWS: IAM User Groups, Roles, Policies and Attachments; S3 buckets; Glue Crawler and At…☆24Jan 31, 2024Updated 2 years ago
- Some code and extra information about the paper "Continued pre-training of LLMs for Portuguese and Government domain: A proposal for prod…☆10Mar 9, 2024Updated 2 years ago
- Extrator de entidades mencionadas em notícias da mídia☆15May 25, 2021Updated 5 years ago
- iOS SDK for integrating BrainBlocks into a mobile app☆12Feb 1, 2021Updated 5 years ago
- Request for Comments focused on Hathor Network☆11Oct 20, 2026Updated 3 weeks ago
- Conjunto de librerías para operar en bolsa Argentina☆12Dec 30, 2019Updated 6 years ago
- A powerful field service assistant that puts user experience first.☆27Updated this week
- Projects and studies regarding Data Engineering Area☆22May 27, 2024Updated 2 years ago
- RAG sobre a rocha — RAG silábico, sem rede neural, sem GPU. Inspecionável, ensinável, roda em qualquer hardware.☆15Nov 2, 2026Updated last week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Script python para automatizar todo o procedimento de lançamento de um foguete incluindo, entrar em orbita, realizar a reentrada e pousar…☆12Oct 12, 2022Updated 4 years ago
- Rotina em python para obtenção de dados dos hospitais brasileiros via Cadastro Nacional de Estabelecimentos de Saúde (CNES)☆18Jan 3, 2024Updated 2 years ago
- A package to help data scientist in Exploratory Data Analysis and Data Preparation for ML models☆22Mar 28, 2026Updated 7 months ago
- ☆11Jun 15, 2019Updated 7 years ago
- En este proyecto se medirá el índice de fiabilidad de una empresa, así como la calidad de las ofertas que publica☆16Oct 27, 2020Updated 6 years ago
- Apartments Data Pipeline using Airflow and Spark.☆24Mar 28, 2022Updated 4 years ago
- Notebooks e dicas sobre Databricks☆29Nov 5, 2024Updated 2 years ago
- Este escript de python esta echo con la idea de reservar de manera automatica un turno para sacar el pasaporte italiano en la paguina web…☆15Feb 16, 2022Updated 4 years ago
- Portfolio of projects and studies conducted in data engineering.☆34Feb 22, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Tool that fetches company data, statistics, and financials for valuation and analysis, and then performs automated valuation analysis.☆25Aug 11, 2020Updated 6 years ago
- This Obsidian plugin enhances your note-taking experience by providing seamless integration with JW Library links and Bible references.☆35Nov 6, 2026Updated last week
- The Monte Carlo valuation app is a Streamlit web application leveraging a probabilistic approach to company valuation.☆23Jan 12, 2025Updated last year
- API para consulta de situação cadastral do CPF na plataforma serpro.☆20Feb 15, 2023Updated 3 years ago
- The Challenges of HackerRank Solved in Scala☆19Dec 7, 2017Updated 8 years ago
- R code and predictions for the case study from Van Calster et al (Validation Studies of Predictive AI for Use in Medical Practice: Overv…☆23Dec 15, 2025Updated 10 months ago
- Serve ML models. Simple. Light.☆42Aug 10, 2023Updated 3 years ago
- Curso Projetos ágeis com SCRUM☆37Sep 28, 2023Updated 3 years ago
- Easily interact with X clipboard from python☆11Oct 20, 2013Updated 13 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Projeto desenvolvido no III Hackfest contra a corrupção - João Pessoa.☆22Oct 30, 2018Updated 8 years ago
- Model Confidence Set (MCS) implementation in Python☆21Oct 21, 2024Updated 2 years ago
- Improving the development of Spark applications deployed as jobs on AWS services like Glue and EMR☆10Jul 26, 2023Updated 3 years ago
- This repository contains example patterns for storing large objects with DynamoDB.☆13Jun 19, 2024Updated 2 years ago
- ☆12Jan 25, 2018Updated 8 years ago
- The open source version of the Amazon Redshift Getting Started Guide.☆15Jun 15, 2023Updated 3 years ago
- Soroswap Core's (AMM, Factroy, Router) smart contracts written in rust with soroban-sdk☆23Sep 6, 2026Updated 2 months ago
Are these results useful?