How do I create a parameter in the console of AWS Data Pipeline

2.6k views Asked by At

I'd like to define some parameters in the console of AWS DataPipeline, but am not able to do so. The parameters are going to be called in a SqlActivity, so when I try to refer to them in the in-line SQL script and save the pipeline, I'm getting error messages saying that no such parameters exist. The parameters page is blank and I can't find the button to make one. Google results are all showing me how to create parameterized pipelines, which is not what I'm exactly looking for

2

There are 2 answers

2
Ramkumar On

At the moment, you cannot create parameter objects from the AWS Datapipeline console. Please use aws cli to create a pipeline definition with parameter objects.

0
Ncs On

I found a workaround for "adding" parameters to your pipeline by creating another one almost identical.

Go to your pipeline definition and click Export. Copy paste the json content to a file on your local machine. In the last rows of the json, find the parameters, here is where you will add as many params as you wish. I will leave a snippet:

    "parameters": [
    {
      "description": “Description example“,
      "id": “myVar1”,
      "myComment": “Comment“,
      "type": "String"
    }
    ],
    "values": {
      “myVar1": “data”
    }

Next time you create the pipeline: Create pipeline -> Source -> Import a definition -> <your_json_definition>