Close popover

Table of Contents

Creating external data flows

Version:

External Data Flow (EDF) is a rule for defining the flow of data on the graphical canvas and executing that flow on an external system. With EDF, you can run predictive analytics models in a Hadoop environment and utilize its infrastructure to process large numbers of records to limit the data transfer between Hadoop and the Pega Platform.

  • External Data Flow rules - Completing the Create, Save As, or Specialization form
  • Data flow tab on the External Data Flow form

    Through an external data flow (EDF), you can sequence and combine data based on an HDFS data set and write the results to a destination. The sequence is established through a set of instructions and execution points from source to destination. Between the source and destination of an external data flow, you can apply predictive model execution, merge, convert, and filter instructions.

  • Configuring YARN settings

    Configure the YARN Resource Manager settings to enable running external data flows (EDFs) on a Hadoop record. When an external data flow is started from Pega Platform, it triggers a YARN application directly on the Hadoop record for data processing.

  • Configuring run-time settings

    You can apply additional JAR file resources to the Hadoop record as part of running an external data flow. When you reference a JAR resource file in the Runtime configuration section, the JAR file is sent to the working directory of the Hadoop record as part of the class path each time you run an external data flow. After an external data flow finishes, the referenced resources are removed from the Hadoop.

  • Creating a rule

    To save time and ensure that your projects adhere to the unique needs of your clients, create rules and data instances using reusable elements of your application. By combining a rule type, name, class, and ruleset, you provide a unique identity for each rule that you create.

  • Copying a rule or data instance

    Use the Save As form to copy an existing record's functionality to a new record with unique key parts. This form is pre-populated with the original record's key parts and creates default values for the new record's context.

  • Creating a specialized or circumstance rule

    You can create a specialized or circumstance rule to create a variant of the rule that can be triggered only conditionally. The created rule is resolved and active only when the specified conditions are met. Create specialized or circumstance rules to address dynamic business requirements without changing the core logic every time. For information about rule resolution exceptions and how they might affect circumstance rules, see .

  • Pega-DecisionEngine agents

    The Pega-DecisionEngine agents support Decision Management operations.

Have a question? Get answers now.

Visit the Collaboration Center to ask questions, engage in discussions, share ideas, and help others.