AI ENGINEERING
Crawling the Web with LLM
Web crawling frameworks and a ScrapeGraphAI example that uses local Ollama models to extract structured information from a webpage.
The notebook / 65 articles
Ideas into practice
Notes on LLMs, machine learning, data engineering, and the systems that make them work.
Showing 41–50 of 65 posts
AI ENGINEERING
LangGraph VS AutoGen
Compare LangGraph and AutoGen across workflow structure, state management, customization, and use cases for LLM applications.
AI ENGINEERING
Autogen Intro and RAG Workflow
AutoGen is a framework for creating multi-agent AI applications that can act autonomously or work alongside humans.
LARGE LANGUAGE MODELS
Local LLM Setup
This guide will walk you through setting up a local language model (LLM) using Ollama. Ollama is an open-source, lightweight language model that can be run locally on your machine...
AI ENGINEERING
Gradio with Ollama
Notes on processing unstructured PDF content and a demo architecture connecting a Gradio interface to models served by Ollama.
DATA ENGINEERING
PySpark Dataframe Transformation
Notes on moving from Scala to PySpark, using Python dataclasses for data models, and creating DataFrames from Row objects.
DATA ENGINEERING
Databricks Wheel Job
Recently I successfully deploy my python wheel to Databricks Cluster. Here are some tips if you plan to deploy pyspark.
SOFTWARE ENGINEERING
ZIO
Recently I read a Blog that introducing how to use scala framework ZIO to build an application.
SOFTWARE ENGINEERING
Reflex Learning
Reflex is a library to build full-stack web apps in pure Python.