Skip to Workflow Atlas
Playbook AtlasWorkflow Atlas
Workflow blueprintBrowse workflows
ETL PipelineAI systemIntermediate

Website Data Aggregation with OpenAI

Website Data Aggregation with OpenAI is a 28-node automation blueprint connecting OpenAI, Supabase. Inspect its trigger, execution graph, branches, and implementation requirements.

OpenAISupabase

Interactive system map

Follow the runtime. Inspect what supports it.

Solid horizontal paths show main-channel execution. Violet dependencies sit beneath the exact step they configure or empower.

28

Nodes

26

Links

3

Run groups

Connected tools

2 integrations

  • OpenAI
  • Supabase

Canvas controls

Fit wide systems, then zoom into any run group.

Website Data Aggregation with OpenAI execution lanes3 run groups containing 28 workflow nodes and 26 visible links. Solid horizontal lines are main-channel runtime links. Violet dashed lines connect typed dependencies beneath the runtime step they support. Focus any node to inspect its immediate path.Execute workflow. trigger node, manualTrigger. 0 incoming and 1 outgoing connections.STARTExecute workflowTRIGGERMANUALTRIGGER0 IN / 1 OUTGet companies. integration node, supabase. 1 incoming and 1 outgoing connections.STEP 02Get companiesINTEGRATIONSUPABASE1 IN / 1 OUTSelect company name and website. transform node, set. 1 incoming and 2 outgoing connections.STEP 03Select company name and w…TRANSFORMSET1 IN / 2 OUTMap company name and website. transform node, set. 1 incoming and 1 outgoing connections.STEP 04Map company name and webs…TRANSFORMSET1 IN / 1 OUTCrawl website. ai node, agent. 5 incoming and 1 outgoing connections.STEP 04Crawl websiteAIAGENT5 IN / 1 OUTSet social media array. transform node, set. 1 incoming and 1 outgoing connections.STEP 05Set social media arrayTRANSFORMSET1 IN / 1 OUTMerge all data. decision node, merge. 2 incoming and 1 outgoing connections.STEP 06Merge all dataDECISIONMERGE2 IN / 1 OUTInsert new row. integration node, supabase. 1 incoming and 0 outgoing connections.OUTCOMEInsert new rowINTEGRATIONSUPABASE1 IN / 0 OUTOpenAI Chat Model. OpenAI node, lmChatOpenAi. 0 incoming and 1 outgoing connections.DEPENDENCY · DEPTH 1OpenAI Chat ModelOPENAILMCHATOPENAI0 IN / 1 OUTText. ai node, toolWorkflow. 0 incoming and 1 outgoing connections.DEPENDENCY · DEPTH 1TextAITOOLWORKFLOW0 IN / 1 OUTURLs. ai node, toolWorkflow. 0 incoming and 1 outgoing connections.DEPENDENCY · DEPTH 1URLsAITOOLWORKFLOW0 IN / 1 OUTJSON Parser. ai node, outputParserStructured. 0 incoming and 1 outgoing connections.DEPENDENCY · DEPTH 1JSON ParserAIOUTPUTPARSERSTRUCTURED0 IN / 1 OUTSet domain (text). transform node, set. 0 incoming and 1 outgoing connections.STARTSet domain (text)TRANSFORMSET0 IN / 1 OUTAdd protocool to domain (text). transform node, set. 1 incoming and 1 outgoing connections.STEP 02Add protocool to domain (…TRANSFORMSET1 IN / 1 OUTGet website (text). integration node, httpRequest. 1 incoming and 1 outgoing connections.STEP 03Get website (text)INTEGRATIONHTTPREQUEST1 IN / 1 OUTConvert HTML to Markdown. integration node, markdown. 1 incoming and 1 outgoing connections.STEP 04Convert HTML to MarkdownINTEGRATIONMARKDOWN1 IN / 1 OUTSet response (text). transform node, set. 1 incoming and 0 outgoing connections.OUTCOMESet response (text)TRANSFORMSET1 IN / 0 OUTSet domain (URL). transform node, set. 0 incoming and 1 outgoing connections.STARTSet domain (URL)TRANSFORMSET0 IN / 1 OUTAdd protocool to domain (URL). transform node, set. 1 incoming and 1 outgoing connections.STEP 02Add protocool to domain (…TRANSFORMSET1 IN / 1 OUTGet website (URL). integration node, httpRequest. 1 incoming and 1 outgoing connections.STEP 03Get website (URL)INTEGRATIONHTTPREQUEST1 IN / 1 OUTRetrieve URLs. integration node, html. 1 incoming and 1 outgoing connections.STEP 04Retrieve URLsINTEGRATIONHTML1 IN / 1 OUTSplit out URLs. transform node, splitOut. 1 incoming and 1 outgoing connections.STEP 05Split out URLsTRANSFORMSPLITOUT1 IN / 1 OUTFilter out empty hrefs. decision node, filter. 1 incoming and 1 outgoing connections.STEP 06Filter out empty hrefsDECISIONFILTER1 IN / 1 OUTRemove duplicated. integration node, removeDuplicates. 1 incoming and 1 outgoing connections.STEP 07Remove duplicatedINTEGRATIONREMOVEDUPLICATES1 IN / 1 OUTSet domain to path. transform node, set. 1 incoming and 1 outgoing connections.STEP 08Set domain to pathTRANSFORMSET1 IN / 1 OUTFilter out invalid URLs. decision node, filter. 1 incoming and 1 outgoing connections.STEP 09Filter out invalid URLsDECISIONFILTER1 IN / 1 OUTAggregate URLs. transform node, aggregate. 1 incoming and 1 outgoing connections.STEP 10Aggregate URLsTRANSFORMAGGREGATE1 IN / 1 OUTSet response (URL). transform node, set. 1 incoming and 0 outgoing connections.OUTCOMESet response (URL)TRANSFORMSET1 IN / 0 OUT

Signal inspector

Focus, hover, or select a step to isolate its runtime and support links.

Main-channel runtimeTyped dependencytriggeraidecisiontransformintegration
Scroll horizontally to follow every connected flow.28 connected nodesEnter or click to lock · Escape to clear

Runtime breakdown

Read the execution spine before its dependencies.

Each run group separates main-channel steps from the models, tools, retrievers, and data services that support them. Start and outcome labels apply only to runtime nodes.

01

Run Group

Execute workflow

8 Execution Links4 Support Dependencies

  1. Start

    Execute workflow

    Trigger

  2. Step 2

    Get companies

    Integration

  3. Step 3

    Select company name and website

    Transform

  4. Step 4

    Map company name and website

    Transform

    Crawl website

    AI reasoning

  5. Step 5

    Set social media array

    Transform

  6. Step 6

    Merge all data

    Decision

  7. Outcome

    Insert new row

    Integration

Attached dependencies

These nodes support the runtime above; they are not additional starts or outcomes.

4 nodes

  • OpenAI Chat Model

    AI reasoning dependency

  • Text

    AI reasoning dependency

  • URLs

    AI reasoning dependency

  • JSON Parser

    AI reasoning dependency

02

Run Group

Set domain (text)

4 Execution Links

  1. Start

    Set domain (text)

    Transform

  2. Step 2

    Add protocool to domain (text)

    Transform

  3. Step 3

    Get website (text)

    Integration

  4. Step 4

    Convert HTML to Markdown

    Integration

  5. Outcome

    Set response (text)

    Transform

03

Run Group

Set domain (URL)

10 Execution Links

  1. Start

    Set domain (URL)

    Transform

  2. Step 2

    Add protocool to domain (URL)

    Transform

  3. Step 3

    Get website (URL)

    Integration

  4. Step 4

    Retrieve URLs

    Integration

  5. Step 5

    Split out URLs

    Transform

  6. Step 6

    Filter out empty hrefs

    Decision

  7. Step 7

    Remove duplicated

    Integration

  8. Step 8

    Set domain to path

    Transform

  9. Step 9

    Filter out invalid URLs

    Decision

  10. Step 10

    Aggregate URLs

    Transform

  11. Outcome

    Set response (URL)

    Transform

Turn the map into a plan

Adapt this blueprint to your company.

Bring the system shape into a workspace, then define the production controls, data boundaries, owners, and delivery sequence around your context.

Create a build planReturn to the atlas