Add weights and move files under Tasks > Jobs. (#8623)
parent
b8c5652751
commit
73589267a1
|
@ -1,5 +1,5 @@
|
|||
---
|
||||
title: "Run Jobs"
|
||||
weight: 60
|
||||
weight: 50
|
||||
---
|
||||
|
||||
|
|
|
@ -3,6 +3,7 @@ title: Running automated tasks with cron jobs
|
|||
reviewers:
|
||||
- chenopis
|
||||
content_template: templates/task
|
||||
weight: 10
|
||||
---
|
||||
|
||||
{{% capture overview %}}
|
||||
|
|
|
@ -1,6 +1,6 @@
|
|||
---
|
||||
title: Coarse Parallel Processing Using a Work Queue
|
||||
toc_hide: true
|
||||
weight: 30
|
||||
---
|
||||
|
||||
{{< toc >}}
|
||||
|
@ -167,13 +167,13 @@ We will use the `amqp-consume` utility to read the message
|
|||
from the queue and run our actual program. Here is a very simple
|
||||
example program:
|
||||
|
||||
{{< code language="python" file="worker.py" >}}
|
||||
{{< code language="python" file="coarse-parallel-processing-work-queue/worker.py" >}}
|
||||
|
||||
Now, build an image. If you are working in the source
|
||||
tree, then change directory to `examples/job/work-queue-1`.
|
||||
Otherwise, make a temporary directory, change to it,
|
||||
download the [Dockerfile](Dockerfile?raw=true),
|
||||
and [worker.py](worker.py?raw=true). In either case,
|
||||
download the [Dockerfile](coarse-parallel-processing-work-queue/Dockerfile?raw=true),
|
||||
and [worker.py](coarse-parallel-processing-work-queue/worker.py?raw=true). In either case,
|
||||
build the image with this command:
|
||||
|
||||
```shell
|
|
@ -1,6 +1,6 @@
|
|||
---
|
||||
title: Fine Parallel Processing Using a Work Queue
|
||||
toc_hide: true
|
||||
weight: 40
|
||||
---
|
||||
|
||||
{{< toc >}}
|
||||
|
@ -111,11 +111,11 @@ called rediswq.py ([Download](rediswq.py?raw=true)).
|
|||
The "worker" program in each Pod of the Job uses the work queue
|
||||
client library to get work. Here it is:
|
||||
|
||||
{{< code language="python" file="worker.py" >}}
|
||||
{{< code language="python" file="fine-parallel-processing-work-queue/worker.py" >}}
|
||||
|
||||
If you are working from the source tree,
|
||||
change directory to the `docs/tasks/job/fine-parallel-processing-work-queue/` directory.
|
||||
Otherwise, download [`worker.py`](worker.py?raw=true), [`rediswq.py`](rediswq.py?raw=true), and [`Dockerfile`](Dockerfile?raw=true)
|
||||
Otherwise, download [`worker.py`](fine-parallel-processing-work-queue/worker.py?raw=true), [`rediswq.py`](fine-parallel-processing-work-queue/rediswq.py?raw=true), and [`Dockerfile`](fine-parallel-processing-work-queue/Dockerfile?raw=true)
|
||||
using above links. Then build the image:
|
||||
|
||||
```shell
|
|
@ -1,5 +1,6 @@
|
|||
---
|
||||
title: Parallel Processing using Expansions
|
||||
weight: 20
|
||||
---
|
||||
|
||||
{{< toc >}}
|
||||
|
|
Loading…
Reference in New Issue