12 posts · 5 companies · newest first
Scrapy 2.19's RemoteControl extension runs a small authenticated HTTP server inside every crawl. How it starts, how it's secured, what the code you send can reach, and what you can do with it on a live crawl, plus the traps and what changes under scrapy-zyte-api.
One Scrapy spider, three browser setups: stock Playwright, Patchright via the new PLAYWRIGHT_BROWSER_PROVIDER hook, and a remote browser on Zyte over CDP. Same spider and selectors throughout, only the browser changes.
In this blog post, we will show you how to set up n8n workflow automation with Docker and PostgreSQL on ... Read More The post How to Set Up n8n Workflow Automation with Docker and PostgreSQL on Ubuntu 26.04 appeared first on RoseHosting.
Distributed systems need async message delivery across nodes. Phoenix provides Phoenix PubSub for this, with pluggable adapters for different backends — officially PG2 and Redis. This post walks through implementing a Phoenix PubSub adapter backed by EventStore, an Elixir event sourcing library that persists events to PostgreSQL as an append-only log. Using EventStore as a PubSub backend has a few advantages over the default PG2 adapter: No Erlang distribution required: nodes communicate through the shared database rather than through the Erlang cluster, so you can run multiple nodes without…
Summary: If you get Python crashing immediately in BirdNetPi, try uninstalling the pyarrow Python package. I’ve got a BirdNetPi set up at home. This is a bit of software that runs on a Raspberry Pi and listens on a microphone (I’ve mounted mine on the outside of an upstairs window, using a 3D printed mount/cover […]
In this tutorial, we will show you how to set up a Django Application with Gunicorn and Nginx on Debian ... Read More The post How to Set Up a Django Application with Gunicorn and NGINX on Debian 13 appeared first on RoseHosting.
Solomon Hykes introduced Docker at PyCon 2013, showcasing its capabilities for packaging and running applications in containers. These containers offer ... Read More The post How to Remove Docker Images on Ubuntu 26.04 appeared first on RoseHosting.
What's the smallest harness that still works? Turns out it's already sitting inside almost every coding agent you have installed — headless mode: same loop, tools, and reasoning as the interactive agent, minus the human in the chair. We point it at a web page and pull clean, structured data out the other end in about ten lines.
A website deployment should not feel like a risky final step. It should be a repeatable process that lets you test, review, approve, and release changes with fewer surprises. This is the main reason teams use a staging-to-production workflow. In this setup, staging acts as a safe testing space, while
Welcome to anyone coming here from April Cools! I usually blog about things like cool geospatial tools, books I’ve read, Python packages I’ve created and more. But today, time for something different… I quite like making decorated birthday cakes (I’ll show some of my favourites at the end of this post), but they generally take […]
A friend was using GDAL’s ogr2ogr command to import some data to PostGIS recently, and as part of the import they were doing a reprojection of the data. They got the following error: PROJ: Cannot open https://cdn.proj.org/uk_os_OSTN15_NTv2_OSGBtoETRS.tif: schannel: the certificate or certificate chain is based on an untrusted root They’ve had various SSL errors on […]
I don’t seem to have time or energy for long posts these days, but here’s another quick post which might save you some time and frustration. Recently, I’ve been trying to import OpenStreetMap data into a PostGIS database to use with pgRouting. I wanted to import data for the whole of England – which has […]