• I have marked all applicable categories:
  • exception-raising bug
  • [ x] visual output bug
  • documentation request (i.e. "X is missing from the documentation." If instead I want to ask "how to use X?" I understand [StackOverflow#tqdm] is more appropriate)
  • new feature request
• [ x] I have visited the [source website], and in particular
  read the [known iss

  /Users/travis/build/ray-project/ray/python/ray/node.py:533: DeprecationWarning: Redis.hmset() is deprecated. Use Redis.hset() instead.
    redis_client.hmset("webui", {"url": self._webui_url})
  /Users/travis/build/ray-project/ray/python/ray/worker.py:358: DeprecationWarning: Redis.hmset() is deprecated. Use Redis.hset() instead.
    "run_on_other_drivers": str(run_on_other_drivers),
  

Currently, if trial.report() method is called multiple times with the same step in a trial, only the first reported value will be recorded into the storage and the others will be silently ignored.
Reporting multiple values with the same step is an unintended usage of the method, and it could cause bugs that are hard to notice (see #847 as an example of such bug).
Therefore, it seems better to

Points to cover:

• playbook for how to get started with testing
• differences between testing locally vs staging vs production
• how to configure tests for different environments

@johngrimsey thank you for the idea! Please feel free to comment if I missed something.