
(Strictly speaking any maintenance of a collection even just "dump everything at my door at I'll put it on the pile" could be considered "curation" but to call a list of tools "curated" suggests there's some selection going on, and there does not appear to be on this list.)ĮDIT: In fact, all of the definitions of "curate" here start with the word "select," for example "Select, organize, and look after the items in (a collection or exhibition)." This fits my meaning.

If you went through & evaluated the books, selecting only those that you'd personally recommend and discarding the rest, that would be a "curated" collection. So for example, if you said "I want to start a library, donate any books you have at my house" that would not be a "curated" collection in my opionion. From a curated selection of tools, I expect to see a selection of the best tools, chosen by a knowledgable curator who has evaluated the tools in some way. Learn, build, test and fail forward without risking unexpected cloud bills.To curate a collection is to be an editor, determining what to include and what to exclude. Membership – For unlimited access to our entire cloud training catalog, enroll in our monthly or annual membership program.Ĭhallenge Labs – Build hands-on cloud skills in a secure sandbox environment. It is always necessary to fully determine your solution requirements before you make a decision as to which service best fits your needs.įor further reading, visit: Become an AWS expert with our value-packed trainingĪWS Training – Our popular AWS training will maximize your chances of passing your AWS certification the first time.

Let’s have a closer look at the benefits and drawbacks of each service. Using Airflow, you can author workflows as Directed Acyclic Graphs (DAGs) of tasks, and Apache Airflow can integrate with many AWS and non-AWS services such as: Amazon Glacier, Amazon CloudWatch Logs and Google Cloud Secret Manager. This powerful and widely-used open-source workflow management system (WMS) allows programmatic creation, scheduling, orchestration, and monitoring of data pipelines and workflows. Apache Airflow is an open-source workflow management platform for data engineering pipelines. What is Apache Airflow?įirstly, Apache Airflow is a third party tool – and is not an AWS Service. The states in your workflow can perform work, make choices, pass parameters, initiate parallel execution, manage timeouts, or terminate your workflow. State machines represent individual steps in a workflow diagram by containing a number of states. Your workflow can be visualized by state machines describing steps, their relationships, and their inputs and outputs. What are AWS Step Functions?ĪWS Step Functions enables you to coordinate distributed applications and microservices through visual workflows. Amazon SWF interacts with workers which are programs that retrieve, process, and return tasks.Īs part of the coordination of tasks, execution dependencies, scheduling, and concurrency are managed accordingly.

The AWS Simple Workflow Service (SWF) allows you to coordinate work between distributed applications.Ī task is an invocation of a logical step in an Amazon SWF application. This article highlights the similarities and differences, benefits, drawbacks, and use cases of these services that see a growing demand. While these services have largely similar pricing, there are different use cases for each service.ĪWS Simple Workflow Service (SWF), AWS Step Functions and Apache Airflow all seem very similar, and at times it may seem difficult to distinguish each service. There are a number of different services and products on the market which support building logic and processes within your application flow.
