I'm Rafael Tedesco, a seasoned Software and Data Engineer with over a decade of experience specializing in planning, building, and maintaining resilient and scalable web applications, and automating processes for data extraction, transformation, and loading (ETL) in Cloud environments. I support business specialists in their decision-making by providing robust data solutions.

What I Bring to the Table:

🚀 Extensive Experience in Data Engineering: Proven track record in developing ETL/ELT automation for data engineering, web applications, and analytics.

🔧 Proficiency in Diverse Technologies: Skilled in Python, SQL, NoSQL, and various cloud services including AWS and Azure.

📊 Building and Optimizing ETL Pipelines: Expertise in creating efficient ETL pipelines for data extraction, transformation, and loading.

🌐 Cloud Expertise: Extensive experience with AWS (Lambda, Glue, Athena, S3, Rekognition, SageMaker, and more) and Azure (Databricks, Data Lake Storage).

📚 Continuous Learning: Always exploring new technologies, development patterns, and best practices to stay ahead in the field.

Key Skills and Technologies:

• Programming Languages: Python
• Types of Database: SQL, NoSQL
• Frameworks and Libraries: Pandas, PySpark, Pydantic, SQLAlchemy, NLTK, Flask, FastAPI, Django, Django Rest Framework, Streamlit, Jinja2, SQLModel, Beautiful Soup, Pillow, Selenium, PyTesseract (OCR Tool), PyPDF2, PyMuPDF, Python-Docx, Boto3, langChain
• Cloud Services: AWS (Lambda, Glue, Athena, S3, Rekognition, SageMaker, etc.), Azure (Databricks, Data Lake Storage Gen2)
• Architecture and Design Patterns: Medallion Architecture, Clean Architecture, Hexagonal Architecture, DDD, TDD, SOLID, OOP Design Patterns, Microservices Design Patterns
• Big Data and Data Streaming: AWS Firehose, RabbitMQ, Kafka, SQS/SNS, RabbitMQ
• Containers: Docker
• BI Tools: Power BI (DAX, Power Query, Data Modeling), Excel
• Machine Learning and AI: Hugging Face, OpenAI, LLM, RAG, scikit-learn
• Other Technologies: Redis, Excel, VBA, GraphQL, JWT, Oauth2, Vector Databases (ChromaDB), SAP Netweaver

PinnedLoading

1. openticket-microservicesopenticket-microservicesPublic

   An application developed to demonstrate the operation and how to create microservices, using different programming languages for each microservice, such as: Python with FastAPI, Java with Spring Bo…

   Java 5

2. Typescript_Design_PatternsTypescript_Design_PatternsPublic

   Example projects applying Design Patterns using Typescript and addopting TDD

   TypeScript 6

3. microservice-example-to-register-users-and-send-email-notificationmicroservice-example-to-register-users-and-send-email-notificationPublic

   JavaScript 5

4. golang-rest-api-study-examplegolang-rest-api-study-examplePublic

   rest api for study

   Go

5. Thiago-Mariotto/menu-online-apiThiago-Mariotto/menu-online-apiPublic

   Uma aplicação simulando um Ecommerce para restaurantes, onde será possível adicionar o cardápio, selecionar items e finalizar uma compra.

   TypeScript 2 1

6. azure-storage-file-system-full-stackazure-storage-file-system-full-stackPublic

   App for frontend file transfers: send multiple files to store in Azure Storage

   TypeScript