Merge pull request #245 from djarecka/satra-enh-dask

adding comments on Dask worker [skip ci]

Author: djarecka

README.md

@@ -14,7 +14,8 @@ Feature list:
 2. Composable dataflows with simple node semantics. A dataflow can be a node of another dataflow.
 3. `splitter` and `combiner` provides many ways of compressing complex loop semantics
 4. Cached execution with support for a global cache across dataflows and users
-5. Distributed execution (presently via ConcurrentFutures and SLURM, more on their way)
+5. Distributed execution, presently via ConcurrentFutures, SLURM,
+and Dask (this is an experimental implementation with limited testing)
 
 [[API Documentation](https://nipype.github.io/pydra/)]
 
@@ -40,6 +41,14 @@ cd pydra
 pip install -e .[dev]
 ```
 
+If you want to test execution with Dask:
+```
+git clone [email protected]:nipype/pydra.git
+cd pydra
+pip install -e .[dask]
+```
+
+
 It is also useful to install pre-commit:
 
 ```

pydra/engine/workers.py

@@ -290,7 +290,9 @@ async def _verify_exit_code(self, jobid):
 
 
 class DaskWorker(Worker):
-    """A worker to execute in parallel using Python's concurrent futures."""
+    """ A worker to execute in parallel using Dask.distributed.
+        This is an experimental implementation with limited testing.
+    """
 
     def __init__(self, **kwargs):
         """Initialize Worker."""