Crawl4AI turns web pages into clean Markdown and JSON for LLM, RAG and data pipelines. This Ubuntu 24.04 AMI runs Crawl4AI with a built-in headless browser behind a private, token-protected HTTPS API, so developers can extract content from JavaScript-heavy pages in their own AWS account.
Crawl4AI fetches web pages with a real headless browser and returns clean Markdown and structured JSON that language models and data pipelines can use directly. This AMI is for developers and data teams building RAG knowledge bases, research tools or monitoring jobs who want a private crawler instead of a third-party scraping API.
What you get: Crawl4AI 0.9.5 with a headless browser, so pages that need JavaScript render correctly, on a token-protected HTTPS API on port 8447 with limits on each crawl. The TLS certificate and API token are created on first boot and are not baked into the image. A guide and walkthrough are under /opt/sushi/docs.
Getting started: launch t3.large (8 GiB RAM) with at least 32 GiB of encrypted gp3 storage, IMDSv2 and AmazonSSMManagedInstanceCore, keep inbound application ports closed and connect with Session Manager. Run sudo -iu ubuntu bash /opt/sushi/docs/demo.sh, then forward port 8447 and run your first crawl with the guide. Respect each website's terms and robots rules.
This is a repackaged open source software product wherein additional charges apply for independent AWS packaging, setup documentation and maintenance by Software Sushi. UncleCode publishes Crawl4AI under the Apache-2.0 license. Software Sushi is independent of the upstream project and does not claim upstream or AWS endorsement. EC2, EBS and data transfer are billed separately from software charges.
Highlights
Turn web pages into clean Markdown and JSON for LLM and RAG pipelines.
Built-in headless browser renders pages that need JavaScript.
Private HTTPS API with a per-instance token and certificate, reached through Session Manager.
AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
This listing uses a single usage-based dimension billed per hour on a t3.large Amazon EC2 instance. You pay the software charge only for the hours the instance runs, so cost scales directly with uptime. There are no tiers or seat counts to choose. The AMI launches in your own AWS account, where you manage the infrastructure. AWS charges for EC2, storage, networking, and data transfer are billed separately from this software fee. Any third-party services you connect may carry their own charges.
Top-of-mind questions for buyers
What compute resources come with the t3.large hourly rate?
The software runs on a t3.large Amazon EC2 instance. This is a general-purpose virtual machine with 2 vCPUs and 8 GiB of memory. You launch one instance in your own AWS account and pay the software charge per hour it runs.
Am I charged the software fee when the instance is stopped?
The software charge meters running hours only. When you stop the instance, the hourly software fee stops accruing. Note that AWS may still bill you for attached storage and other resources while the instance is stopped. Those AWS charges are separate from the software fee.
What costs are not included in the hourly software price?
The hourly price covers the software only. AWS bills separately for the EC2 instance, storage, networking, and data transfer. Any model providers or other external services you connect through the extractor's API may also charge for their own usage. Review the current listing before subscribing.
softwaresushi.com
Helpful?
Vendor refund policy
We offer a full refund of software charges for the first 48 hours billing starts if the product does not perform as described. To request a refund, email info@softwaresushi.com with your EC2 instance ID and a description of the issue. AWS infrastructure costs (EC2, EBS, data transfer) and any third-party service charges are not eligible for refund by us.
How can we make this page better?
Tell us how we can improve this page, or report an issue with this product.
Give us feedbackReport a problem with this product or seller
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA).
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
An AMI is a virtual image that provides the information required to launch an instance. Amazon EC2 (Elastic Compute Cloud) instances are virtual servers on which you can run your applications and workloads, offering varying combinations of CPU, memory, storage, and networking resources. You can launch as many instances from as many different AMIs as you need.
Version release notes
Crawl4AI 0.9.5 on Ubuntu 24.04 for t3.large. The crawler listens on port 8447 on the instance only, with a token and certificate created on first boot. Connect with Session Manager as ubuntu and run sudo -iu ubuntu bash /opt/sushi/docs/demo.sh after cloud-init finishes.
Additional details
Usage instructions
Launch t3.large with at least 8 GiB RAM and 32 GiB encrypted gp3 root storage. Require IMDSv2. Attach AmazonSSMManagedInstanceCore. Leave inbound application ports closed.
Wait until cloud-init finishes. First boot creates this instance's TLS certificate and API token and starts the crawler on port 8447. Do not print the token.
sudo -iu ubuntu bash /opt/sushi/docs/demo.sh
From your computer, start a Session Manager port-forwarding session to instance port 8447 and follow the guide at /opt/sushi/docs/README.md. Trust the instance certificate before calling the API. Upstream Crawl4AI documentation: https://docs.crawl4ai.com/.
Software Sushi provides installation and configuration guidance for this image. Contact info@softwaresushi.com with your product version and reproduction steps; never send keys or private configuration. Guaranteed response times require a separate agreement. This offer does not include upstream project support.
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Pre-installed and security-hardened OpenClaw AI agent AMI. Launch an EC2 instance, add your credentials, and start using your agent. Ready to configure out of the box.
This product has charges associated with it for seller support and packaging. Run the open-source Browser Use Python agent with local headless Chromium and your own model provider on Ubuntu 24.04.
Open WebUI is a self-hosted, ChatGPT-style chat interface for any OpenAI-compatible model endpoint. Give your team one private place to chat with the models you choose. This Ubuntu 24.04 AMI runs Open WebUI v0.11.4 on localhost with a session secret generated per instance, reachable through Session Manager port forwarding.
Be the first to review this product. We've partnered with PeerSpot to gather customer feedback. You can share your experience by writing or recording a review, or scheduling a call with a PeerSpot analyst.