Dataset enrichment using LLM’s ✨
Large Language Models (LLM's) have proven to be useful for numerous tasks. LLM's can summarise text, generate text, classify text or translate text. What LLM's can also be used for is converting unstructured data to structured data.
Scaling up: bringing your Azure DevOps CI/CD setup to the next level 🚀
Azure DevOps pipelines are a great way to automate your CI/CD process. But what if you have many projects? In this blog post, we will show you how you can scale up your Azure DevOps CI/CD setup for reusability and easy maintenance.
PyData Eindhoven 2023
Eindhoven, The Netherlands —
LLM data extraction: prompt engineering, JSON output modes, Function calling, Pydantic schemas, evaluation and a GPT 3.5 vs GPT 4 vs PaLM showdown.
GoDataFest 2023
Amsterdam, The Netherlands —
How can we extract more value from data by using what LLMs can offer us? Previously impossible data extractions can be now done and a new level of data quality and direct filtering can now be realized.
DataMass Gdańsk Summit 2023
Gdańsk, Poland —
Enriching datasets with LLMs: JSON output modes, schema definitions with Pydantic, evaluating structured data extraction, Function Calling.
A sunrise in Hamburg
0:00
/0:27
1×
Sometimes, it's nice just to observe. To watch, as the world wakes up.
PyData Eindhoven 2022
Eindhoven, The Netherlands —
Devcontainer deep dive. Covering the Devcontainers rationale, the new containers.dev specification by the Microsoft team, Linux Docker essentials, mounts, ports, IDE integration and a practical guide on how you can create a Devcontainer for a Python project yourself.
fseval: A Benchmarking Framework for Feature Selection and Feature Ranking Algorithms
Journal of Open Source Software — A Python package for benchmarking Feature Selection and Feature Ranking algorithms at scale: parallel and distributed experiments, fully reproducible from a config file, with results exported to SQL.
How to create a Devcontainer for your Python project 🐳
Instead of giving other developers a setup document, let’s make sure we also create formal instructions so we can automatically set up the development environment. Devcontainers let us do exactly this.
GoDataFest 2022
Amsterdam, The Netherlands —
Talk on Devcontainers. Motivating developer environment discrepancies, their consequences and the resolution: using Devcontainers. Covers the Devcontainer specification, linux user permissions, filesystem mounts, opening up ports, running Devcontainers in CI and more.
A novel evaluation methodology for supervised Feature Ranking algorithms
arXiv — A new, systematic evaluation methodology for Feature Rankers using synthetic datasets with known feature importances, and a large-scale benchmark run with fseval on an HPC cluster.
The beauties of Peru
From the sea to the mountains to the jungle and back.
From Linear Regression to Neural Networks
How are linear regression, logistic regression and neural networks related? What is overfitting and how do we fight it? In this post, we find answers to these questions in an interactive way by working with a real-world dataset on penguins.
