Report generated on 08-Sep-2014 at 11:21:02 by gaiatest version 0.27

Configuration

Device firmware (date) 27 Jun 2014 15:57:58
Device firmware (incremental) 110
Device firmware (release) 4.3
Device identifier flame
Gaia date 06 Sep 2014 02:48:04
Gaia revision c7de02ef1e0a
Gecko build 20140907160202
Gecko revision 2255d7d187b2
Gecko version 35.0a1

Summary

40 tests ran in 2757 seconds.
35 passed, 91 skipped, 2 failed, 1 errors.
0 expected failures, 0 unexpected passes.

Results

Result Class Test Name Duration Links
Passed test_browser_cell_data.TestBrowserCellData test_browser_cell_data 90.9
Passed test_browser_lan.TestBrowserLAN test_browser_lan 82.9
Passed test_browser_play_youtube_video.TestYouTube test_play_youtube_video 97.7
Passed test_calendar_new_event_appears_on_all_calendar_views.TestCalendar test_that_new_event_appears_on_all_calendar_views 87.5
Passed test_camera_capture_video.TestCamera test_capture_a_video 63.3
Passed test_camera_multiple_shots.TestCameraMultipleShots test_capture_multiple_shots 60.3
Passed test_cards_view_with_two_apps.TestCardsView test_that_app_can_be_launched_from_cards_view 58.7
Passed test_clock_create_new_alarm.TestClockCreateNewAlarm test_clock_create_new_alarm 93.7
Passed test_add_new_contact.TestContacts test_add_new_contact 64.1
Passed test_edit_contact.TestContacts test_edit_contact 64.4
Error test_sms_contact.TestContacts test_sms_contact 18.0
Traceback (most recent call last):
File "/var/lib/jenkins/jobs/B2G.master.pvt.flame.gaiatest.smoketest/workspace/tests/python/gaia-ui-tests/.env/local/lib/python2.7/site-packages/marionette_client-0.8.4-py2.7.egg/marionette/marionette_test.py", line 246, in run
self.setUp()
File "/var/lib/jenkins/jobs/B2G.master.pvt.flame.gaiatest.smoketest/workspace/tests/python/gaia-ui-tests/gaiatest/tests/functional/contacts/test_sms_contact.py", line 14, in setUp
GaiaTestCase.setUp(self)
File "/var/lib/jenkins/jobs/B2G.master.pvt.flame.gaiatest.smoketest/workspace/tests/python/gaia-ui-tests/gaiatest/gaia_test.py", line 744, in setUp
self.device.start_b2g()
File "/var/lib/jenkins/jobs/B2G.master.pvt.flame.gaiatest.smoketest/workspace/tests/python/gaia-ui-tests/gaiatest/gaia_test.py", line 562, in start_b2g
self.marionette.start_session()
File "/var/lib/jenkins/jobs/B2G.master.pvt.flame.gaiatest.smoketest/workspace/tests/python/gaia-ui-tests/.env/local/lib/python2.7/site-packages/marionette_client-0.8.4-py2.7.egg/marionette/marionette.py", line 816, in start_session
self.session = self._send_message('newSession', 'value')
File "/var/lib/jenkins/jobs/B2G.master.pvt.flame.gaiatest.smoketest/workspace/tests/python/gaia-ui-tests/.env/local/lib/python2.7/site-packages/marionette_client-0.8.4-py2.7.egg/marionette/decorators.py", line 35, in _
return func(*args, **kwargs)
File "/var/lib/jenkins/jobs/B2G.master.pvt.flame.gaiatest.smoketest/workspace/tests/python/gaia-ui-tests/.env/local/lib/python2.7/site-packages/marionette_client-0.8.4-py2.7.egg/marionette/marionette.py", line 615, in _send_message
response = self.client.send(message)
File "/var/lib/jenkins/jobs/B2G.master.pvt.flame.gaiatest.smoketest/workspace/tests/python/gaia-ui-tests/.env/local/lib/python2.7/site-packages/marionette_transport-0.3-py2.7.egg/marionette_transport/transport.py", line 101, in send
response = self.receive()
File "/var/lib/jenkins/jobs/B2G.master.pvt.flame.gaiatest.smoketest/workspace/tests/python/gaia-ui-tests/.env/local/lib/python2.7/site-packages/marionette_transport-0.3-py2.7.egg/marionette_transport/transport.py", line 58, in receive
raise IOError(self.connection_lost_msg)
IOError: Connection to Marionette server is lost. Check gecko.log (desktop firefox) or logcat (b2g) for errors.
Passed test_add_photo_to_contact.TestContacts test_add_photo_from_gallery_to_contact 62.2
Passed test_cost_control_data_alert_mobile.TestCostControlDataAlertMobile test_cost_control_data_alert_mobile 114.3
Passed test_dialer.TestDialer test_dialer_make_call 61.6
Passed test_call_log_all_calls.TestCallLogAllCalls test_call_log_all_calls 64.4
Skipped test_dialer_receive_call.TestReceiveCall test_receive_call 0.0
Plivo account details not present in test variables
Skipped test_dialer_receive_call_with_locked_screen.TestReceiveCallScreenLocked test_receive_call_with_locked_screen 0.0
Plivo account details not present in test variables
Passed test_setup_basic_gmail.TestSetupGmail test_setup_basic_gmail 72.0
Passed test_setup_and_send_imap_email.TestSetupAndSendIMAPEmail test_setup_and_send_imap_email 148.5
Passed test_everythingme_launch_link.TestEverythingMeLaunchLink test_launch_everything_me_link 74.3
Passed test_everythingme_add_collection_save_bookmark.TestEverythingMeAddCollectionSaveBookmark test_everythingme_add_collection 88.1
Passed test_fmradio_frequency_dialer.TestFMRadioFreqDialer test_radio_frequency_dialer 66.0
Passed test_ftu_skip_tour.TestFtu test_ftu_skip_tour 78.2
Passed test_ftu_with_tour.TestFtu test_ftu_with_tour 63.1
Passed test_gallery_view.TestGallery test_gallery_view 60.0
Passed test_gallery_flick.TestGallery test_gallery_full_screen_image_flicks 64.2
Passed test_homescreen_delete_app.TestDeleteApp test_delete_app 79.8
Passed test_homescreen_move_app.TestMoveApp test_move_app_position 81.6
Passed test_lockscreen_unlock_to_homescreen.TestLockScreen test_unlock_to_homescreen 52.1
Passed test_lockscreen_unlock_to_camera.TestLockScreen test_unlock_to_camera 55.7
Failure test_lockscreen_unlock_to_camera_with_passcode.TestCameraUnlockWithPasscode test_unlock_to_camera_with_passcode 57.5 Source Screenshot Settings
Traceback (most recent call last):
File "/var/lib/jenkins/jobs/B2G.master.pvt.flame.gaiatest.smoketest/workspace/tests/python/gaia-ui-tests/.env/local/lib/python2.7/site-packages/marionette_client-0.8.4-py2.7.egg/marionette/marionette_test.py", line 264, in run
testMethod()
File "/var/lib/jenkins/jobs/B2G.master.pvt.flame.gaiatest.smoketest/workspace/tests/python/gaia-ui-tests/gaiatest/tests/functional/lockscreen/test_lockscreen_unlock_to_camera_with_passcode.py", line 35, in test_unlock_to_camera_with_passcode
self.assertTrue(self.device.is_locked)
AssertionError: False is not true
Passed test_marketplace_launch.TestMarketplaceLaunch test_marketplace_launch 61.6
Passed test_sms.TestSms test_sms_send 78.6
Passed test_sms_with_attachments.TestSmsWithAttachments test_sms_send 90.0
Passed test_music_album_mp3.TestMusic test_select_album_play 61.0
Passed test_music_songs_3gp.TestPlay3GPMusic test_select_songs_play_3gp_file 60.7
Passed test_settings_bluetooth.TestBluetoothSettings test_toggle_bluetooth_settings 82.2
Passed test_settings_dsds_cell_data.TestDSDSCellData test_cell_data_for_two_sims 62.1
Failure test_power_button_long_press.TestPowerButton test_power_button_long_press 51.9 Source Screenshot Settings
Traceback (most recent call last):
File "/var/lib/jenkins/jobs/B2G.master.pvt.flame.gaiatest.smoketest/workspace/tests/python/gaia-ui-tests/.env/local/lib/python2.7/site-packages/marionette_client-0.8.4-py2.7.egg/marionette/marionette_test.py", line 264, in run
testMethod()
File "/var/lib/jenkins/jobs/B2G.master.pvt.flame.gaiatest.smoketest/workspace/tests/python/gaia-ui-tests/gaiatest/tests/functional/system/test_power_button_long_press.py", line 28, in test_power_button_long_press
self.assertIn(item, sleep_menu_items)
AssertionError: 'Ring incoming calls' not found in [u'Turn on airplane mode', u'Silence incoming calls', u'Restart', u'Power off']
Passed test_play_3gp_video.TestPlay3GPVideo test_play_3gp_video 60.0
Skipped test_setup_and_send_active_sync_email.py 0
Bug 1028192 - Problems with ActiveSync accounts
Skipped test_receive_active_sync_email.py 0
Bug 1028192 - Problems with ActiveSync accounts
Skipped test_ftu_skip_tour_desktopb2g.py 0
skip-if: device != "desktop"
Skipped test_settings_cell_data.py 0
skip-if: device == "desktop" || device == "sp7710gaplus_gonk" || device == "flame"
Skipped test_settings_sim_manager.py 0
Disabled because run the device with 1 SIM only
Skipped test_browser_tabs.py 0
filtered by type (b2g+smoketest)
Skipped test_browser_search.py 0
filtered by type (b2g+smoketest)
Skipped test_browser_navigation.py 0
filtered by type (b2g+smoketest)
Skipped test_browser_bookmark.py 0
filtered by type (b2g+smoketest)
Skipped test_calendar_flick_through_months.py 0
filtered by type (b2g+smoketest)
Skipped test_camera_capture_photo.py 0
filtered by type (b2g+smoketest)
Skipped test_camera_flash_modes.py 0
filtered by type (b2g+smoketest)
Skipped test_cards_view_kill_apps_with_two_apps.py 0
filtered by type (b2g+smoketest)
Skipped test_clock_set_alarm.py 0
filtered by type (b2g+smoketest)
Skipped test_call_contact.py 0
filtered by type (b2g+smoketest)
Skipped test_sort_contacts.py 0
filtered by type (b2g+smoketest)
Skipped test_delete_contact.py 0
filtered by type (b2g+smoketest)
Skipped test_add_contact_to_favorites.py 0
filtered by type (b2g+smoketest)
Skipped test_import_contacts_from_sim.py 0
filtered by type (b2g+smoketest)
Skipped test_export_contacts_to_sdcard.py 0
filtered by type (b2g+smoketest)
Skipped test_import_contacts_from_sdcard.py 0
filtered by type (b2g+smoketest)
Skipped test_import_contacts_from_gmail.py 0
filtered by type (b2g+smoketest)
Skipped test_cost_control_ftu.py 0
filtered by type (b2g+smoketest)
Skipped test_cost_control_reset_wifi.py 0
filtered by type (b2g+smoketest)
Skipped test_dialer_airplane_mode.py 0
filtered by type (b2g+smoketest)
Skipped test_MMI.py 0
filtered by type (b2g+smoketest)
Skipped test_dialer_add_contact.py 0
filtered by type (b2g+smoketest)
Skipped test_dialer_find_contact.py 0
filtered by type (b2g+smoketest)
Skipped test_everythingme_search.py 0
filtered by type (b2g+smoketest)
Skipped test_fmradio_add_remove_from_favorites.py 0
filtered by type (b2g+smoketest)
Skipped test_fmradio_find_stations.py 0
filtered by type (b2g+smoketest)
Skipped test_fmradio_turn_on_off.py 0
filtered by type (b2g+smoketest)
Skipped test_gallery_empty.py 0
filtered by type (b2g+smoketest)
Skipped test_gallery_delete_image.py 0
filtered by type (b2g+smoketest)
Skipped test_gallery_edit_photo.py 0
filtered by type (b2g+smoketest)
Skipped test_gallery_crop_photo.py 0
filtered by type (b2g+smoketest)
Skipped test_homescreen_edit_mode.py 0
filtered by type (b2g+smoketest)
Skipped test_homescreen_launch_app.py 0
filtered by type (b2g+smoketest)
Skipped test_keyboard.py 0
filtered by type (b2g+smoketest)
Skipped test_number_keyboard.py 0
filtered by type (b2g+smoketest)
Skipped test_keyboard_predictive_key.py 0
filtered by type (b2g+smoketest)
Skipped test_email_keyboard.py 0
filtered by type (b2g+smoketest)
Skipped test_lockscreen_unlock_to_homescreen_with_passcode.py 0
filtered by type (b2g+smoketest)
Skipped test_lockscreen_unlock_to_emergency_call_screen.py 0
filtered by type (b2g+smoketest)
Skipped test_lockscreen_notification.py 0
filtered by type (b2g+smoketest)
Skipped test_lockscreen_wake_with_notification.py 0
filtered by type (b2g+smoketest)
Skipped test_add_to_an_existing_contact_from_messages.py 0
filtered by type (b2g+smoketest)
Skipped test_add_to_new_contact_from_messages.py 0
filtered by type (b2g+smoketest)
Skipped test_sms_add_contact.py 0
filtered by type (b2g+smoketest)
Skipped test_sms_to_dialer.py 0
filtered by type (b2g+smoketest)
Skipped test_sms_contact_match.py 0
filtered by type (b2g+smoketest)
Skipped test_sms_contact_input_validation.py 0
filtered by type (b2g+smoketest)
Skipped test_sms_notification.py 0
filtered by type (b2g+smoketest)
Skipped test_mms_add_subject.py 0
filtered by type (b2g+smoketest)
Skipped test_inbox_to_settings.py 0
filtered by type (b2g+smoketest)
Skipped test_music_empty.py 0
filtered by type (b2g+smoketest)
Skipped test_persona_app.py 0
filtered by type (b2g+smoketest)
Skipped test_settings_change_language.py 0
filtered by type (b2g+smoketest)
Skipped test_settings_change_language_rtl.py 0
filtered by type (b2g+smoketest)
Skipped test_settings_gps.py 0
filtered by type (b2g+smoketest)
Skipped test_settings_do_not_track.py 0
filtered by type (b2g+smoketest)
Skipped test_settings_wifi.py 0
filtered by type (b2g+smoketest)
Skipped test_settings_airplane_mode.py 0
filtered by type (b2g+smoketest)
Skipped test_settings_media_storage.py 0
filtered by type (b2g+smoketest)
Skipped test_settings_wallpaper.py 0
filtered by type (b2g+smoketest)
Skipped test_settings_passcode.py 0
filtered by type (b2g+smoketest)
Skipped test_settings_change_keyboard_language.py 0
filtered by type (b2g+smoketest)
Skipped test_settings_device_info.py 0
filtered by type (b2g+smoketest)
Skipped test_settings_power_save_mode.py 0
filtered by type (b2g+smoketest)
Skipped test_settings_root.py 0
filtered by type (b2g+smoketest)
Skipped test_system_notification_bar.py 0
filtered by type (b2g+smoketest)
Skipped test_geolocation_prompt.py 0
filtered by type (b2g+smoketest)
Skipped test_quick_settings.py 0
filtered by type (b2g+smoketest)
Skipped test_system_message.py 0
filtered by type (b2g+smoketest)
Skipped test_system_message_pending.py 0
filtered by type (b2g+smoketest)
Skipped test_inter_app_comm.py 0
filtered by type (b2g+smoketest)
Skipped test_privileged_app_audio_capture_prompt.py 0
filtered by type (b2g+smoketest)
Skipped test_privileged_app_video_capture_prompt.py 0
filtered by type (b2g+smoketest)
Skipped test_privileged_app_contacts_prompt.py 0
filtered by type (b2g+smoketest)
Skipped test_privileged_app_device_music_prompt.py 0
filtered by type (b2g+smoketest)
Skipped test_privileged_app_device_picture_prompt.py 0
filtered by type (b2g+smoketest)
Skipped test_privileged_app_device_sdcard_prompt.py 0
filtered by type (b2g+smoketest)
Skipped test_privileged_app_device_video_prompt.py 0
filtered by type (b2g+smoketest)
Skipped test_privileged_app_geolocation_prompt.py 0
filtered by type (b2g+smoketest)
Skipped test_video_empty.py 0
filtered by type (b2g+smoketest)
Skipped test_play_ogv_video.py 0
filtered by type (b2g+smoketest)
Skipped test_play_webm_video.py 0
filtered by type (b2g+smoketest)
Skipped test_play_mp4_video.py 0
filtered by type (b2g+smoketest)
Skipped test_play_ogg_video.py 0
filtered by type (b2g+smoketest)