Skip to Workflow Atlas
ETL PipelineAI systemIntermediate

HN Hiring Post Scraper and AI Parser

HN Hiring Post Scraper and AI Parser is a 15-node automation blueprint connecting OpenAI, Airtable, Hacker News API. Inspect its trigger, execution graph, branches, and implementation requirements.

Interactive system map

Follow the runtime. Inspect what supports it.

Solid horizontal paths show main-channel execution. Violet dependencies sit beneath the exact step they configure or empower.

15

Nodes

14

Links

1

Run groups

Connected tools

3 integrations

  • OpenAI
  • Airtable
  • Hacker News API

Canvas controls

Fit wide systems, then zoom into any run group.

HN Hiring Post Scraper and AI Parser execution lanes1 run groups containing 15 workflow nodes and 14 visible links. Solid horizontal lines are main-channel runtime links. Violet dashed lines connect typed dependencies beneath the runtime step they support. Focus any node to inspect its immediate path.When clicking ‘Test workflow’. trigger node, manualTrigger. 0 incoming and 1 outgoing connections.STARTWhen clicking ‘Test workf…TRIGGERMANUALTRIGGER0 IN / 1 OUTSearch for Who is hiring posts. integration node, httpRequest. 1 incoming and 1 outgoing connections.STEP 02Search for Who is hiring …INTEGRATIONHTTPREQUEST1 IN / 1 OUTSplit Out. transform node, splitOut. 1 incoming and 1 outgoing connections.STEP 03Split OutTRANSFORMSPLITOUT1 IN / 1 OUTGet relevant data. transform node, set. 1 incoming and 1 outgoing connections.STEP 04Get relevant dataTRANSFORMSET1 IN / 1 OUTGet latest post. decision node, filter. 1 incoming and 1 outgoing connections.STEP 05Get latest postDECISIONFILTER1 IN / 1 OUTHN API: Get Main Post. integration node, httpRequest. 1 incoming and 1 outgoing connections.STEP 06HN API: Get Main PostINTEGRATIONHTTPREQUEST1 IN / 1 OUTSplit out children (jobs). transform node, splitOut. 1 incoming and 1 outgoing connections.STEP 07Split out children (jobs)TRANSFORMSPLITOUT1 IN / 1 OUTHI API: Get the individual job post. integration node, httpRequest. 1 incoming and 1 outgoing connections.STEP 08HI API: Get the individua…INTEGRATIONHTTPREQUEST1 IN / 1 OUTExtract text. transform node, set. 1 incoming and 1 outgoing connections.STEP 09Extract textTRANSFORMSET1 IN / 1 OUTClean text. transform node, code. 1 incoming and 1 outgoing connections.STEP 10Clean textTRANSFORMCODE1 IN / 1 OUTLimit for testing (optional). integration node, limit. 1 incoming and 1 outgoing connections.STEP 11Limit for testing (option…INTEGRATIONLIMIT1 IN / 1 OUTTrun into structured data. ai node, chainLlm. 3 incoming and 1 outgoing connections.STEP 12Trun into structured dataAICHAINLLM3 IN / 1 OUTWrite results to airtable. Airtable node, airtable. 1 incoming and 0 outgoing connections.OUTCOMEWrite results to airtableAIRTABLEAIRTABLE1 IN / 0 OUTOpenAI Chat Model. OpenAI node, lmChatOpenAi. 0 incoming and 1 outgoing connections.DEPENDENCY · DEPTH 1OpenAI Chat ModelOPENAILMCHATOPENAI0 IN / 1 OUTStructured Output Parser. ai node, outputParserStructured. 0 incoming and 1 outgoing connections.DEPENDENCY · DEPTH 1Structured Output ParserAIOUTPUTPARSERSTRUCTURED0 IN / 1 OUT

Signal inspector

Focus, hover, or select a step to isolate its runtime and support links.

Main-channel runtimeTyped dependencytriggeraidecisiontransformintegration
Scroll horizontally to follow every connected flow.15 connected nodesEnter or click to lock · Escape to clear

Runtime breakdown

Read the execution spine before its dependencies.

Each run group separates main-channel steps from the models, tools, retrievers, and data services that support them. Start and outcome labels apply only to runtime nodes.

01

Run Group

When clicking ‘Test workflow’

12 Execution Links2 Support Dependencies
  1. Start

    When clicking ‘Test workflow’

    Trigger

  2. Step 2

    Search for Who is hiring posts

    Integration

  3. Step 3

    Split Out

    Transform

  4. Step 4

    Get relevant data

    Transform

  5. Step 5

    Get latest post

    Decision

  6. Step 6

    HN API: Get Main Post

    Integration

  7. Step 7

    Split out children (jobs)

    Transform

  8. Step 8

    HI API: Get the individual job post

    Integration

  9. Step 9

    Extract text

    Transform

  10. Step 10

    Clean text

    Transform

  11. Step 11

    Limit for testing (optional)

    Integration

  12. Step 12

    Trun into structured data

    AI reasoning

  13. Outcome

    Write results to airtable

    Integration

Attached dependencies

These nodes support the runtime above; they are not additional starts or outcomes.

2 nodes
  • OpenAI Chat Model

    AI reasoning dependency

  • Structured Output Parser

    AI reasoning dependency

Turn the map into a plan

Adapt this blueprint to your company.

Bring the system shape into a workspace, then define the production controls, data boundaries, owners, and delivery sequence around your context.