I put together an Ansible role to deploy and configure OpenStack Rally. I used the upstream rally bits for this and could be built on Fedora or CentOS/RHEL machines. You could get the playbook from here: https://github.com/juliovp01/rally-deployment .
More details about the role could be found in the README file in GitHub.
Please feel free to fix and provide enhancements to the code.