CraftConf2015

KO | EN

gitlite — search

#javascript #python #hacktoberfest #ai #typescript #machine-learning #deep-learning #linux #docker #nodejs #java #vue #pytorch #mcp

(★ 12)

This repo contains the reference materials to my Craft Conf 2015 talk

CraftConf2015 Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Testing and Integration (The Remix)

Accompanying repository for the "Testing and Integration (The Remix)" talk given at [CraftConf 2015](http://craft-conf.com/2015). Feel free to open any issues for questions and/or to say hi :)

## Abstract
Let's face it, testing distributed systems is hard.  Large number of inputs, partial failures, and asynchrony make these systems seemingly impossible to verify.  Formal testing methods are onerous and system correctness continues to elude us.
Despite the difficulty, we need to have a way to change our systems with confidence.  Integration and unit tests are vital to our sanity and we know it's good for us to use continuous integration to ensure functional consistency across our products.

Come to this talk for a fresh and practical look into the various aspects of distributed systems testing and integration. We will cover CI pipelines: their strengths, weaknesses, and ways to  improvement them. Get ready to rediscover the untapped power of your integration practices and develop a burning desire to make them more awesome!

## Talk Outline
See the [image credits](credits.md), link to [slides](https://speakerdeck.com/randommood/testing-and-integration-the-remix), and [video](http://www.ustream.tv/recorded/61449003)

The talk is broken down in 3 main sessions:
* Testing Distributed Systems
  * Challenges of testing
  * Distributed System Testing in Academia
* Continuous Integration
  * CI challenges
  * Patterns
* Conclusions

The epic soundtrack to this talk can be found on the [CraftConfTalk](https://open.spotify.com/user/randommood/playlist/6DWpHPDyR2F7yBZW4iKL2U) Spotify playlist. If you liked this talk and you are interested in Computer Science check out [Papers We Love](http://paperswelove.org/). We have chapters in many cities and aim to bring academic research close to practitioners.

![XKCD code quality](http://imgs.xkcd.com/comics/code_quality.png)

# References

### Distributed Systems Testing
* [My RICON 2014 talk](https://github.com/Randommood/RICON2014) has a deeper look into academic testing.

### Testing practices
* http://www.mountaingoatsoftware.com/blog/the-forgotten-layer-of-the-test-automation-pyramid
* http://technologyconversations.com/2013/12/24/test-driven-development-tdd-best-practices-using-java-examples-2/
* [Canary Tests](http://java.dzone.com/articles/canary-tests)
* http://martinfowler.com/bliki/TestPyramid.html
* http://google-engtools.blogspot.com/2011/06/testing-at-speed-and-scale-of-google.html
* http://googletesting.blogspot.com/
* [Development at Google](http://www.infoq.com/presentations/Development-at-Google) and [slides](https://qconsf.com/sf2010/dl/qcon-sanfran-2010/slides/AshishKumar_DevelopingProductsattheSpeedandScaleofGoogle.pdf)
* [How Google tests software](http://ptgmedia.pearsoncmg.com/images/9780321803023/samplepages/0321803027.pdf)
* [Google Test and Automation Conference](https://developers.google.com/google-test-automation-conference/2014/presentations)
* [Golang Testing](http://www.golang-book.com/12/index.htm)
* [Unit Testing in Golang](http://whizdumb.me/2015/01/21/unit-testing-in-golang/)
* [TDD in Golang](http://blog.stretchr.com/2014/03/05/test-driven-development-specifically-in-golang/)
* [Canary Analyze All The Things: How We Learned to Keep Calm and Release Often](http://www.infoq.com/presentations/canary-analysis-deployment-pattern) by Roy Rapoport of Netflix

### Continuous Integration
* http://en.wikipedia.org/wiki/Continuous_integration
* http://martinfowler.com/articles/continuousIntegration.html
* http://www.thoughtworks.com/continuous-integration
* http://www.amazon.com/gp/product/0321336380
* http://www.slant.co/topics/186/compare/~circleci_vs_shippable_vs_codeship
* https://www.quora.com/What-is-the-difference-between-Bamboo-CircleCI-CIsimple-Ship-io-Codeship-Jenkins-Hudson-Semaphoreapp-Shippable-Solano-CI-TravisCI-and-Wercker
* [CircleCI Configuration](https://circleci.com/docs/configuration)
* [TravisCI Getting Started](http://docs.travis-ci.com/user/getting-started/)
* [TravisCI Common build problems](http://docs.travis-ci.com/user/common-build-problems/)
* [Flickr's flipping out blogpost](http://code.flickr.net/2009/12/02/flipping-out/)

### Accessibility
* http://www.karlgroves.com/2014/03/13/everything-you-know-about-accessibility-testing-is-wrong-part-4/
* http://pivotallabs.com/accessibility-ci-failures/

### Code Quality
* https://codeclimate.com/

### Continuous Delivery
* [Continuous Deployment @ Flickr](https://vimeo.com/24542044)
* https://www.chef.io/solutions/continuous-delivery/
* [ChefConf 2015: Chef Delivery talk](https://www.youtube.com/watch?v=fMyWM2LkwBk) & [Slides](https://speakerdeck.com/sfalcon/delivery-with-chef)
* https://github.com/opscode-cookbooks/delivery-truck
* https://github.com/chef/delivery-cli
* [Package Management in Chef](https://www.youtube.com/watch?v=-HJ7EZ85THU&index=34&list=PL11cZfNdwNyO9CpTWH2qjYfzysEtpfOCd)
* [On Delivery lumosity blogpost](http://engineering.lumosity.com/operations/2012/02/04/on-delivery/)

### DevOpsy
* [Adam Jacob's ChefConf 2015 keynote](https://www.youtube.com/watch?v=_DEToXsgrPc) & https://github.com/chef/devops-kungfu
* [ChefConf 2014: Jamie Winsor, "The Berkshelf Vision"](https://www.youtube.com/watch?v=Dq_vGxd-jps)
* [How does Etsy manage development and operations](https://codeascraft.com/2011/02/04/how-does-etsy-manage-development-and-operations/)
* [Flickr](http://code.flickr.net/2009/12/02/flipping-out/)
* [10+ Deploys Per Day: Dev and Ops Cooperation at Flickr](http://www.slideshare.net/jallspaw/10-deploys-per-day-dev-and-ops-cooperation-at-flickr)

### General
* http://en.wikipedia.org/wiki/Linear_system

### Media Playlists
* [My CraftConf 2015 CI playlist](https://www.youtube.com/playlist?list=PLEthkXlpCZSVapdLBkxKXigVKIUhe8P8o)
* [My CraftConf Talk Spotify playlist](https://open.spotify.com/user/randommood/playlist/6DWpHPDyR2F7yBZW4iKL2U)

## Thank You
Thank you to everyone who helped with feedback/resources and advice for this talk. Special thanks to: Caitie McCaffrey, Jordan West, Jon Hyman, Bruce Spang, Devon O’Dell, Kelsey Gilmore-Innis, Aysylu Greenberg, Alan Kasindorf, Paul Reed, André Arko, Mike O’Neill, Thomas Mahoney, Eric Kustarz, Ian Fung, Neha Narula, Karl Smith, and Greg Bako.

CraftConf2015

CraftConf2015 Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

CraftConf2015

CraftConf2015 Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README