Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly
Sign up
Appearance settings

Commit 285162f

Browse files
[SDP] DataflowGraph.reanalyzeFlow
1 parent f0bbed8 commit 285162f

File tree

4 files changed

+19
-5
lines changed

4 files changed

+19
-5
lines changed

‎docs/declarative-pipelines/DataflowGraph.md

Lines changed: 12 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@
1111
`DataflowGraph` is created when:
1212

1313
* `DataflowGraph` is requested to [reanalyzeFlow](#reanalyzeFlow)
14-
* `GraphRegistrationContext` is requested to [toDataflowGraph](GraphRegistrationContext.md#toDataflowGraph)
14+
* `GraphRegistrationContext` is requested to [convert to a DataflowGraph](GraphRegistrationContext.md#toDataflowGraph)
1515

1616
## reanalyzeFlow { #reanalyzeFlow }
1717

@@ -20,14 +20,22 @@ reanalyzeFlow(
2020
srcFlow: Flow): ResolvedFlow
2121
```
2222

23-
`reanalyzeFlow`...FIXME
23+
`reanalyzeFlow` [finds the upstream datasets](GraphOperations.md#dfsInternal).
24+
25+
`reanalyzeFlow` finds the upstream flows (for the upstream datasets that could be found in the [resolvedFlows](#resolvedFlows) registry).
26+
27+
`reanalyzeFlow` finds the upstream views (for the upstream datasets that could be found in the [view](#view) registry).
28+
29+
`reanalyzeFlow` creates a new (sub)[DataflowGraph](#creating-instance) for the upstream flows, views and a single table (the [destination](Flow.md#identifier) of the given [Flow](Flow.md)).
30+
31+
`reanalyzeFlow` requests the subgraph to [resolve](#resolve) and returns the [ResolvedFlow](ResolvedFlow.md) for the given [Flow](Flow.md).
2432

2533
---
2634

2735
`reanalyzeFlow` is used when:
2836

29-
* `BatchTableWrite` is requested to [executeInternal](BatchTableWrite.md#executeInternal)
30-
* `StreamingTableWrite` is requested to [startStream](StreamingTableWrite.md#startStream)
37+
* `BatchTableWrite` is requested to [executeAsync](FlowExecution.md#executeAsync) (and [executeInternal](BatchTableWrite.md#executeInternal))
38+
* `StreamingTableWrite` is requested to [executeAsync](FlowExecution.md#executeAsync) (and [startStream](StreamingTableWrite.md#startStream))
3139

3240
## Resolve { #resolve }
3341

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,3 @@
1+
# GraphOperations
2+
3+
`GraphOperations` is...FIXME

‎docs/declarative-pipelines/GraphRegistrationContext.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,7 @@
1616

1717
* `DataflowGraphRegistry` is requested to [createDataflowGraph](DataflowGraphRegistry.md#createDataflowGraph)
1818

19-
## Create DataflowGraph { #toDataflowGraph }
19+
## Convert to DataflowGraph { #toDataflowGraph }
2020

2121
```scala
2222
toDataflowGraph: DataflowGraph
Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,3 @@
1+
# ResolvedFlow
2+
3+
`ResolvedFlow` is...FIXME

0 commit comments

Comments
(0)

AltStyle によって変換されたページ (->オリジナル) /