CHIMPS is a collection of tools to smoke test projects out of repositories.
My adventure with this toolset started as a simple task. I wanted to add smoking of our product RTIR. Well, now I know for sure what "yak shaving" means. At the end we have git support, less bandwidth, faster tests, new options, API for new repositories and new options.
Some use cases have been described earlier.
Recently uploaded two new development releases of Test-Chimps and Test-Chimps-Client distributions to the CPAN. You're welcome to try with your projects and report back using http://rt.cpan.org or this blog.