snowshu.core.graph_set_runner

class snowshu.core.graph_set_runner.GraphExecutable(graph: networkx.classes.graph.Graph, source_adapter: snowshu.adapters.source_adapters.base_source_adapter.BaseSourceAdapter, target_adapter: snowshu.adapters.target_adapters.base_target_adapter.BaseTargetAdapter, analyze: bool)

Bases: object

analyze: bool = None
graph: nx.Graph = None
source_adapter: BaseSourceAdapter = None
target_adapter: BaseTargetAdapter = None
class snowshu.core.graph_set_runner.GraphSetRunner

Bases: object

barf_output = 'snowshu_barf_output'
execute_graph_set(graph_set: Tuple[networkx.classes.graph.Graph], source_adapter: snowshu.adapters.source_adapters.base_source_adapter.BaseSourceAdapter, target_adapter: snowshu.adapters.target_adapters.base_target_adapter.BaseTargetAdapter, threads: int, retry_count: int, analyze: bool = False, barf: bool = False) → None

Processes the given graphs in parallel based on the provided adapters

Parameters
  • graph_set (list) – list of graphs to process

  • source_adapter (BaseSourceAdapter) – source adapter for the relations

  • target_adapter (BaseTargetAdapter) – target adapter for the relations

  • threads (int) – number of threads to use for parallelization

  • retry_count (int) – number of times to retry failed query

  • analyze (bool) – whether to run analyze or actually transfer the sampled data

  • barf (bool) – whether to dump diagnostic files to disk

process_executables(executables, executor, retries, wait_time=30)