========================== #opendaylight-meeting: TWS ========================== Meeting started by phrobb at 17:01:23 UTC. The full logs are available at http://meetings.opendaylight.org/opendaylight-meeting/2014/tws/opendaylight-meeting-tws.2014-07-28-17.01.log.html . Meeting summary --------------- * agenda (colindixon, 17:03:32) * LINK: https://wiki.opendaylight.org/view/Tech_Work_Stream:Main the agenda can be found here (colindixon, 17:03:58) * we’re moving to a new model where we’re trying to post topics on that link and pick one by end of the meeting, you should look at them or add ones that you’d like (preferably with you name and a time estimate) (colindixon, 17:06:08) * testing for projects in helium (colindixon, 17:06:20) * LINK: https://wiki.opendaylight.org/view/Simultaneous_Release:Project_Expectations#Testing this is the curent landing page for testing expecations for each project in Helium (colindixon, 17:07:26) * LINK: https://wiki.opendaylight.org/view/CrossProject:Integration_Group:Testopia some documentation on Testopia which enables interaction with bugzilla (colindixon, 17:09:30) * LINK: https://bugs.opendaylight.org/ to access testopia go here, log in and then go to the “product dashboard” on the left (colindixon, 17:10:34) * you can then expand “Unclassified” and click on “integration” and then “test plans” to see the example which LuisGomez has set up (colindixon, 17:11:38) * each project *should* create tests for every feature they’re providing (colindixon, 17:13:01) * you can create a new test plan (with lots of different types, e.g., system, performance, integration) by going to File => New Test Plan (colindixon, 17:15:58) * each test plan have have multiple test cases, to see them you can click on the number (ID) of the test plan and then click on the test cases tab in the detail page for the plan (colindixon, 17:16:42) * Testopia is actually just a way to document the test plans and cases rather than to automate testing (colindixon, 17:19:43) * colindixon asks if there is a plan to automate the system testing (colindixon, 17:22:02) * LuisGomez responds that the usual way to (1) document the test process, (2) manually go through the test, (3) then automate the test (colindixon, 17:22:53) * Madhu asks about the Test Runs and Builds tabs (colindixon, 17:23:06) * LuisGomez explains that Test Runs is for reporing a single execution (manual or automated) from a Test Plan (colindixon, 17:23:52) * Madhu says he *really* likes the real-time feedback from the jenkins pattern we have now, and wonders how useful some documentation-only tool like Testopia is (colindixon, 17:27:35) * there is a long discussion about how to automate this testing so that we can have things stay more in-sync (colindixon, 17:36:44) * regXboi also asks how to spin up and down VMs to do more extensive testing and can we deal with that (colindixon, 17:37:41) * tykeal says that with the exception of three projects (integration, ovsdb, and controller) we have all projects fully moved into rackspace (colindixon, 17:38:48) * that means that projects other than those can actually be given the ability to spin up and down VMs as part of tests (colindixon, 17:39:13) * LINK: http://www.rackspace.com/blog/installing-rackspace-private-cloud-in-20-minutes-or-less/ - rackspace seems to detail installing an Ubuntu image... (edwarnicke, 17:39:24) * tykeal says that if people reach out to the linux foundation and let them know what you need from VMs (colindixon, 17:41:19) * LINK: : This may also help: https://developer.rackspace.com/blog/vagrant-now-supports-rackspace-open-cloud/ (edwarnicke, 17:41:35) * migrating VMs into rackspace is error prone and booting custom VMs seems to take a long time in the linux foundations experience (colindixon, 17:44:41) * ACTION: some of Madhu, LuisGomez, edwarnicke, tykeal and regXboi should get together offline to see what can’t be done about spinning up VMs easily for tests on rackspace (colindixon, 17:45:29) * colindixon asks LuisGomez what *exactly* the integration project is asking the other projects to do? (colindixon, 17:46:40) * Luis and Integration team need two things: 1 - need documentation from projects for what they are doing for own unit and integration tests. Second, for those projects that want something in System test, they need to work with the Integration project to document the test plan for the project within a system test. (phrobb, 17:47:28) * the integration project’s requests from other projects (colindixon, 17:52:10) * there are two requests (colindixon, 17:52:19) * something like this : http://maven.apache.org/surefire/maven-surefire-report-plugin/usage.html (Madhu, 17:52:58) * the first is that projects need to document the existing tests they run in a place that integration can easily find without having to go through each project individually (colindixon, 17:53:31) * the second is that projects that want tests to be run when their features are loaded into a full distribution need to reach out to integration to talk about the tests (colindixon, 17:54:10) * ACTION: LuisGomez and Madhu to come up with good way for projects to provide useful docuementation of their testing to the integration project (colindixon, 17:57:45) * (colindixon, 17:57:52) * other issues in testing (colindixon, 17:57:59) * ACTION: edwarnicke to send out an email around his wants/needs when it comes to combined reporting of test health from all projects (colindixon, 17:58:41) Meeting ended at 18:06:03 UTC. Action items, by person ----------------------- * edwarnicke * some of Madhu, LuisGomez, edwarnicke, tykeal and regXboi should get together offline to see what can’t be done about spinning up VMs easily for tests on rackspace * edwarnicke to send out an email around his wants/needs when it comes to combined reporting of test health from all projects * Madhu * some of Madhu, LuisGomez, edwarnicke, tykeal and regXboi should get together offline to see what can’t be done about spinning up VMs easily for tests on rackspace * LuisGomez and Madhu to come up with good way for projects to provide useful docuementation of their testing to the integration project * regXboi * some of Madhu, LuisGomez, edwarnicke, tykeal and regXboi should get together offline to see what can’t be done about spinning up VMs easily for tests on rackspace * tykeal * some of Madhu, LuisGomez, edwarnicke, tykeal and regXboi should get together offline to see what can’t be done about spinning up VMs easily for tests on rackspace People present (lines said) --------------------------- * colindixon (37) * regXboi (9) * phrobb (6) * odl_meetbot (5) * Madhu (4) * tykeal (2) * tbachman (2) * edwarnicke (2) * CASP3R (2) Generated by `MeetBot`_ 0.1.4