snowshu.core.graph_set_runner¶
-
class
snowshu.core.graph_set_runner.
GraphExecutable
(graph: networkx.classes.graph.Graph, source_adapter: snowshu.adapters.source_adapters.base_source_adapter.BaseSourceAdapter, target_adapter: snowshu.adapters.target_adapters.base_target_adapter.BaseTargetAdapter, analyze: bool)¶ Bases:
object
-
analyze
: bool = None¶
-
graph
: nx.Graph = None¶
-
source_adapter
: BaseSourceAdapter = None¶
-
target_adapter
: BaseTargetAdapter = None¶
-
-
class
snowshu.core.graph_set_runner.
GraphSetRunner
¶ Bases:
object
-
barf_output
= 'snowshu_barf_output'¶
-
execute_graph_set
(graph_set: Tuple[networkx.classes.graph.Graph], source_adapter: snowshu.adapters.source_adapters.base_source_adapter.BaseSourceAdapter, target_adapter: snowshu.adapters.target_adapters.base_target_adapter.BaseTargetAdapter, threads: int, retry_count: int, analyze: bool = False, barf: bool = False) → None¶ Processes the given graphs in parallel based on the provided adapters
- Parameters
graph_set (list) – list of graphs to process
source_adapter (BaseSourceAdapter) – source adapter for the relations
target_adapter (BaseTargetAdapter) – target adapter for the relations
threads (int) – number of threads to use for parallelization
retry_count (int) – number of times to retry failed query
analyze (bool) – whether to run analyze or actually transfer the sampled data
barf (bool) – whether to dump diagnostic files to disk
-
process_executables
(executables, executor, retries, wait_time=30)¶
-