Comparison of continuous integration software
hideThis article has multiple issues. Please help or discuss these issues on the talk page. (Learn how and when to remove these template messages)
|
This is a compendium of continuous integration software that supports a software engineering practice, continuous integration,[1] in which developers' changes are immediately tested and reported when they are added to the mainline code base. The comparison of various continuous integration tools is done on the basis of platform, license, builders and Integration IDEs.
Features[]
This list is incomplete; you can help by . (June 2018) |
Name | Platform | License | Builders: Windows | Builders: Java | Builders: other | Notification | Integration, IDEs | Integration, other |
---|---|---|---|---|---|---|---|---|
Apache Gump | Python | Apache 2.0 | Unknown | Ant, Maven 1 | Unknown | Unknown | Unknown | |
AppVeyor | Hosted, Self-Hosted | Proprietary | Visual Studio, MSBuild, Psake | No | Custom Script, PowerShell | Email, HipChat, Slack, Catlight | No | GitHub, Bitbucket, Kiln, Windows Azure |
Azure DevOps Server (formerly TFS and VSTS) | Cross-platform | Proprietary, MIT | MSBuild, Visual Studio | Ant, Maven, Gradle, Android | C, C++, Go, Groovy, Java, Node.js, Perl, PHP, Python, Ruby | Email, SOAP, Catlight | Visual Studio, Eclipse, IntelliJ IDEA, Android Studio, Visual Studio Code | GitHub, Jenkins, Slack, Hipchat, FindBugs, Checkstyle, PMD |
Bamboo | Web container | Proprietary | MSBuild,[2] NAnt,[3] Visual Studio[4] | Ant,[5] Maven 1-2-3[6] | Custom script, command-line tool, Bash, Xcode,[7] Phing,[8] Grunt, Grails[9] | XMPP, Google Talk, Email, RSS, Remote API, HipChat | IntelliJ IDEA, Eclipse, Visual Studio | FishEye, Jira, Clover, Bitbucket, GitHub |
Buddy | Cross-platform | Proprietary | No | Ant, Maven, Gradle | Elixir, Go, Haskell, Node.js, PHP, Python, Ruby, .NET Core | Desktop, Email, Slack, SMS | No |
Web Services, Bitbucket, GitHub, GitLab, Google Cloud Services, Heroku, Modulus |
Buildbot | Python | GPL | Command-line | Command-line | Command-line | Email, Web, GUI, IRC | Unknown | Unknown |
BuildMaster | Cross-platform | Proprietary | Yes | Yes | Cross-platform command-line | Email, custom | No | Many |
GitLab | Hosted, Self-Hosted | Proprietary, MIT | Yes[10] | Maven,[11] Gradle[12] | SSH, Shell, VirtualBox, Parallels, Docker, Kubernetes, Custom[13] | Email, Web, Slack and others[14] | Gitpod,[15] WebIDE[16] | Many |
GoCD | Cross-platform | Apache 2.0 | Command-line | Command-line | Command-line | Email, hipchat, Slack, Gerrit, Gitter, Riemann etc | No | GitHub |
Jenkins | Web container | Creative Commons and MIT | MSBuild, NAnt, Batch Script | Ant, Maven 2, Kundo | CMake, Gant, Gradle, Grails, Phing, Rake, Ruby, SCons, Python, shell script, command-line | Android, Email, Google Calendar, IRC, XMPP, RSS, Twitter, Slack, Catlight, CCMenu, CCTray | Eclipse, IntelliJ IDEA, NetBeans | Bugzilla, Google Code, Jira, Bitbucket, Redmine, FindBugs, Checkstyle, PMD and Mantis, Trac, HP ALM |
OpenMake Software Meister | Cross-platform | Proprietary | MSBuild, NAnt, Visual Studio | Ant, Maven 1-2-3 | Shell script, batch script, cross-platform command-line, Groovy, Make, RTC Jazz, TFS Build, Custom Script Interpreter | Email, XMPP, RSS, Systray | Eclipse, Visual Studio | Bugzilla, Google Code, Jira, Bitbucket, Redmine, FindBugs, Checkstyle, PMD and Mantis, Trac |
Semaphore (software) | Hosted | Proprietary | No | Maven, Gradle | Ruby, Java, Python, Node.js, PHP, Clojure, C/C++, Elixir, Erlang, Go, Rake, command-line | Email, Campfire, HipChat, Slack, Flowdock, Webhooks, Remote API | Unknown | GitHub, Bitbucket, Heroku, AWS, Code Climate,[17] Cloud 66 |
Travis CI | Hosted | MIT | No | Ant, Maven, Gradle[18] | C, C++, Clojure, Elixir, Erlang, Go, Groovy, Haskell, Java, Node.js, Perl, PHP, Python, Ruby, Rust, Scala, Smalltalk | Email, Campfire, HipChat, IRC, Slack, Catlight, CCMenu, CCTray | No | GitHub, Heroku |
TeamCity | Web container | Proprietary | MSBuild, NAnt, Visual Studio, ReSharper-based .NET code analysis | Ant, Maven 2-3, Gradle, IntelliJ IDEA-based build and code analysis | command-line, PowerShell,[19] Xcode,[20] Rake, FxCop | Email, XMPP, RSS, IDE, SysTray, Catlight | Eclipse, Visual Studio, IntelliJ IDEA, RubyMine, PyCharm, PhpStorm, WebStorm | JetBrains YouTrack, Jira, Bugzilla, FishEye, FindBugs, PMD, dotCover, NCover |
Vexor | Hosted | Proprietary | No | Unknown | Ruby, Clojure, Scala, Python, Node.js, Go, Rust, Haskell | Email, HipChat, Slack | Unknown | GitHub, Bitbucket, Gitlab |
SCM system support[]
The following table compares the features of some of the most popular Continuous Integration software on the basis of the Source Control Management or the Version Control Management which is an essential part of CI Software system. The table shows some popular SCMs and whether they are supported by the CI software.
Name | AccuRev | BitKeeper | CA Harvest | ClearCase | CVS | Darcs | Git | GNU Bazaar | Integrity | Mercurial | Perforce | Plastic | PVCS | StarTeam | Subversion | Surround | Synergy | Team Concert | TFVC | Vault | Visual SourceSafe |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Apache Gump | No | No | No | No | Yes | No | No | No | No | No | No | No | No | No | Yes | No | No | No | No | No | No |
AppVeyor | No | No | No | No | No | No | Yes | No | No | Yes | No | No | No | No | Yes[21] | No | No | No | No | No | No |
Azure DevOps Server | No | No | No | No | No | No | Yes | No | No | No | No | No | No | No | Yes | No | No | No | Yes | No | No |
Bamboo | Yes[22] | No | No | Yes | Yes | No | Yes | No | No | Yes | Yes | No | No | No | Yes | No | No | No | Yes[23] | No | No |
Buddy | No | No | No | No | No | No | Yes | No | No | No | No | No | No | No | No | No | No | No | No | No | No |
BuildBot | No | No | No | No | Yes | Yes | Yes | Yes | No | Yes | Yes | No | No | No | Yes | No | No | No | No | No | No |
BuildMaster | Yes | No | No | Yes | Yes | No | Yes | No | Yes | Yes | Yes | Yes | Yes | No | Yes | Yes | No | No | Yes | Yes | Yes |
Jenkins | Yes | Yes | Yes | Yes | Yes | Yes[24] | Yes | Yes | Yes[25] | Yes | Yes | Yes[26] | Yes | Yes | Yes | Yes[27] | Yes[28] | Yes[29] | Yes | Yes[30] | Yes |
OpenMake Software Meister | Yes | No | Yes | Yes | Yes | No | Yes | No | Yes | No | Yes | No | Yes | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes |
Semaphore (software) | No | No | No | No | No | No | Yes | No | No | No | No | No | No | No | No | No | No | No | No | No | No |
TeamCity | Yes | No | No | Yes | Yes | No | Yes | Yes[31] | No | Yes | Yes | No | No | Yes | Yes | No | No | No | Yes | Yes | Yes |
Vexor | No | No | No | No | No | No | Yes | No | No | No | No | No | No | No | No | No | No | No | No | No | No |
References[]
- ^ Integration, Continuous (2007). Continuous Integration: Improving Software Quality and Reducing Risk. Pearson Education. ISBN 9780321630148.
- ^ "MSBuild | Bamboo Server 8.0 | Atlassian Documentation". confluence.atlassian.com.
- ^ "NAnt | Bamboo Server 8.0 | Atlassian Documentation". confluence.atlassian.com.
- ^ "Visual Studio | Bamboo Server 8.0 | Atlassian Documentation". confluence.atlassian.com.
- ^ "Ant | Bamboo Server 8.0 | Atlassian Documentation". confluence.atlassian.com.
- ^ "Maven | Bamboo Server 8.0 | Atlassian Documentation". confluence.atlassian.com.
- ^ "Xcode | Bamboo Server 8.0 | Atlassian Documentation". confluence.atlassian.com.
- ^ "Phing | Bamboo Server 5.10 | Atlassian Documentation". confluence.atlassian.com.
- ^ "Grails | Bamboo Server 5.11 | Atlassian Documentation". confluence.atlassian.com.
- ^ "Install GitLab Runner on Windows | GitLab". docs.gitlab.com.
- ^ "Maven packages in the Package Repository | GitLab". docs.gitlab.com.
- ^ "Unit test reports | GitLab". docs.gitlab.com.
- ^ "Executors | GitLab". docs.gitlab.com.
- ^ "Project integrations | GitLab". docs.gitlab.com.
- ^ "Gitpod Integration | GitLab". docs.gitlab.com.
- ^ "Web IDE | GitLab". docs.gitlab.com.
- ^ Code Climate "Getting Started with Code Climate Quality: Setting Up Test Coverage".
- ^ "Travis CI Documentation". docs.travis-ci.com.
- ^ "PowerShell | TeamCity On-Premises". TeamCity On-Premises Help.
- ^ "Xcode Project | TeamCity On-Premises". TeamCity On-Premises Help.
- ^ "Build Environment".
- ^ "Atlassian Marketplace". marketplace.atlassian.com.
- ^ "Atlassian Marketplace". marketplace.atlassian.com.
- ^ "Darcs Plugin - Jenkins - Jenkins Wiki".
- ^ "PTC Windchill RV&S CM". PTC Windchill RV&S CM.
- ^ "PlasticSCM Plugin - Jenkins - Jenkins Wiki".
- ^ "Surround SCM Plugin - Jenkins - Jenkins Wiki".
- ^ "Synergy Plugin - Jenkins - Jenkins Wiki".
- ^ "Team Concert". Team Concert.
- ^ "SourceGear Vault". SourceGear Vault.
- ^ "Bazaar - TeamCity Plugin". JetBrains Marketplace.
Further reading[]
- Paul M. Duvall, Steve Matyas, Andrew Glover (2007-06-29). Continuous Integration: Improving Software Quality and Reducing Risk. ISBN 9780321630148.CS1 maint: multiple names: authors list (link)
- Ching, Maria Odea; Porter, Brett (2009-09-15). Apache Maven 2 Effective Implementation: Build and Manage Applications with Maven, Continuum, and Archiva. Packt Publishing Ltd. ISBN 9781847194558.
- Melymuka, Volodymyr (2012-01-01). TeamCity 7 Continuous Integration Essentials. Packt Publishing Ltd. ISBN 9781849693776.
Categories:
- Continuous integration
- Software comparisons