A Practical Example of the Pipeline Pattern in Python

What is this pattern about? The Pipeline design pattern (also known as Chain of Command pattern) is a flexible way to handle a sequence of actions, where each handler in the chain processes the input data and passes it to the next handler. This pattern is commonly used in scenarios involving data processing, web scraping,… Continue reading A Practical Example of the Pipeline Pattern in Python

Data engineering involves more Python than you might think!

Listen here: This week we have Christo back on the show to talk about his experience in the data engineering field. He shares some valuable tips how to become a more effective data engineer which, surprisingly or not, increasingly requires a well-rounded Python developer skill set. Enjoy and feel free to reach out to Christo below … Christo’s website: https://www.christoolivier.com… Continue reading Data engineering involves more Python than you might think!

How to Run External Python Libraries in AWS Cloud

AWS Lambda is awesome, but sometimes it can be hard to get external libraries working in this serverless environment. No worries, we learned a lesson or two which I will share in this article. Ready to run almost any Python library in the cloud? This should excite you and even trigger your entrepeneurial mind …