Report generated on 25-Jun-2015 at 05:10:01 by gaiatest-v2.2 version 0.1

Configuration

Device firmware (base) L1TC100118D0
Device firmware (date) 19 Jun 2015 16:30:02
Device firmware (incremental) eng.cltbld.20150619.042950
Device firmware (release) 4.4.2
Device identifier flame
Gaia date 19 Jun 2015 09:36:47
Gaia revision 1c33072e33c2
Gecko build 20150619002501
Gecko revision 5ad34a170633
Gecko version 37.0

Summary

45 tests ran in 3679 seconds.
40 passed, 130 skipped, 1 failed, 4 errors.
0 expected failures, 0 unexpected passes.

Results

Result Class Test Name Duration Links
Passed test_browser_cell_data.TestBrowserCellData test_browser_cell_data 93.6
Passed test_browser_lan.TestBrowserLAN test_browser_lan 94.3
Passed test_browser_play_video.TestVideo test_play_video 90.5
Passed test_calendar_new_event_appears_on_all_calendar_views.TestCalendar test_that_new_event_appears_on_all_calendar_views 91.6
Passed test_camera_capture_video.TestCamera test_capture_a_video 65.5
Passed test_camera_multiple_shots.TestCameraMultipleShots test_capture_multiple_shots 67.1
Passed test_cards_view_with_two_apps.TestCardsView test_that_app_can_be_launched_from_cards_view 63.5
Passed test_clock_create_new_alarm.TestClockCreateNewAlarm test_clock_create_new_alarm 148.4
Passed test_add_new_contact.TestContacts test_add_new_contact 76.5
Passed test_edit_contact.TestContacts test_edit_contact 72.3
Passed test_sms_contact.TestContacts test_sms_contact 86.0
Passed test_add_photo_to_contact.TestContacts test_add_photo_from_gallery_to_contact 72.8
Passed test_cost_control_data_alert_mobile.TestCostControlDataAlertMobile test_cost_control_data_alert_mobile 128.9
Passed test_dialer.TestDialer test_dialer_make_call 68.4
Passed test_dialer_receive_call.TestReceiveCall test_receive_call 73.6
Passed test_dialer_receive_call_with_locked_screen.TestReceiveCallScreenLocked test_receive_call_with_locked_screen 80.7
Passed test_setup_basic_gmail.TestSetupGmail test_setup_basic_gmail 91.8
Error test_setup_and_send_imap_email.TestSetupAndSendIMAPEmail test_setup_and_send_imap_email 57.3
Traceback (most recent call last):
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.smoketest/tests/python/gaia-ui-tests/.env/local/lib/python2.7/site-packages/marionette_client_mozilla_b2g37_v2_2-0.1-py2.7.egg/marionette/marionette_test.py", line 268, in run
testMethod()
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.smoketest/tests/python/gaia-ui-tests/gaiatest/tests/functional/email/test_setup_and_send_imap_email.py", line 33, in test_setup_and_send_imap_email
self.email.setup_IMAP_email(self.account)
TypeError: setup_IMAP_email() takes exactly 3 arguments (2 given)
Error test_IMAP_email_notification.TestEmailNotification test_IMAP_email_notification 59.9
Traceback (most recent call last):
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.smoketest/tests/python/gaia-ui-tests/.env/local/lib/python2.7/site-packages/marionette_client_mozilla_b2g37_v2_2-0.1-py2.7.egg/marionette/marionette_test.py", line 268, in run
testMethod()
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.smoketest/tests/python/gaia-ui-tests/gaiatest/tests/functional/email/test_IMAP_email_notification.py", line 32, in test_IMAP_email_notification
self.email.setup_IMAP_email(self.testvars['email']['IMAP'])
TypeError: setup_IMAP_email() takes exactly 3 arguments (2 given)
Error test_rocketbar_add_collection_save_bookmark.TestRocketBarAddCollectionSaveBookmark test_rocketbar_add_collection 92.4
Traceback (most recent call last):
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.smoketest/tests/python/gaia-ui-tests/.env/local/lib/python2.7/site-packages/marionette_client_mozilla_b2g37_v2_2-0.1-py2.7.egg/marionette/marionette_test.py", line 268, in run
testMethod()
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.smoketest/tests/python/gaia-ui-tests/gaiatest/tests/functional/rocketbar/test_rocketbar_add_collection_save_bookmark.py", line 20, in test_rocketbar_add_collection
collection_activity = contextmenu.tap_add_collection()
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.smoketest/tests/python/gaia-ui-tests/gaiatest/apps/homescreen/regions/context_menu.py", line 31, in tap_add_collection
return CollectionsActivity(self.marionette)
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.smoketest/tests/python/gaia-ui-tests/gaiatest/apps/homescreen/regions/collections_activity.py", line 24, in __init__
Wait(self.marionette).until(expected.element_not_displayed(loading))
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.smoketest/tests/python/gaia-ui-tests/.env/local/lib/python2.7/site-packages/marionette_client_mozilla_b2g37_v2_2-0.1-py2.7.egg/marionette/wait.py", line 143, in until
cause=last_exc)
TimeoutException: TimeoutException: Timed out after 30.3 seconds
Passed test_fmradio_frequency_dialer.TestFMRadioFreqDialer test_radio_frequency_dialer 71.6
Failure test_ftu_skip_tour.TestFtu test_ftu_skip_tour 80.6
Traceback (most recent call last):
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.smoketest/tests/python/gaia-ui-tests/.env/local/lib/python2.7/site-packages/marionette_client_mozilla_b2g37_v2_2-0.1-py2.7.egg/marionette/marionette_test.py", line 268, in run
testMethod()
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.smoketest/tests/python/gaia-ui-tests/gaiatest/tests/functional/ftu/test_ftu_skip_tour.py", line 99, in test_ftu_skip_tour
self.assertTrue(self.data_layer.get_setting('debug.performance_data.shared'))
AssertionError: False is not true
Passed test_ftu_with_tour.TestFtu test_ftu_with_tour 79.9
Passed test_ftu_status_bar.TestFtu test_ftu_status_bar 75.9
Passed test_gallery_view.TestGallery test_gallery_view 60.8
Passed test_gallery_flick.TestGallery test_gallery_full_screen_image_flicks 68.1
Passed test_homescreen_delete_app.TestDeleteApp test_delete_app 101.0
Passed test_homescreen_delete_app_packaged.TestDeleteApp test_delete_app 102.7
Passed test_homescreen_launch_app.TestLaunchApp test_launch_app 88.5
Passed test_homescreen_launch_app_packaged.TestLaunchApp test_launch_app 90.9
Passed test_homescreen_move_app.TestMoveApp test_move_app_position 96.2
Passed test_lockscreen_unlock_to_homescreen.TestLockScreen test_unlock_to_homescreen 55.6
Passed test_lockscreen_unlock_to_camera.TestLockScreen test_unlock_to_camera 62.2
Passed test_lockscreen_unlock_to_camera_with_passcode.TestCameraUnlockWithPasscode test_unlock_to_camera_with_passcode 63.6
Passed test_marketplace_launch.TestMarketplaceLaunch test_marketplace_launch 65.7
Passed test_marketplace_packaged_app.TestSearchMarketplaceAndInstallApp test_search_and_install_app 107.3
Passed test_sms.TestSms test_sms_send 84.5
Passed test_sms_with_attachments.TestSmsWithAttachments test_sms_send 109.8
Passed test_sms_with_picture_attached.TestSmsWithPictureAttached test_sms_cropped_picture 112.5
Passed test_music_artist_mp3.TestMusic test_select_artist_play 66.3
Passed test_settings_bluetooth.TestBluetoothSettings test_toggle_bluetooth_settings 85.7
Error test_settings_wifi.TestSettingsWifi test_connect_to_wifi_via_settings_app 66.4
Traceback (most recent call last):
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.smoketest/tests/python/gaia-ui-tests/.env/local/lib/python2.7/site-packages/marionette_client_mozilla_b2g37_v2_2-0.1-py2.7.egg/marionette/marionette_test.py", line 268, in run
testMethod()
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.smoketest/tests/python/gaia-ui-tests/gaiatest/tests/functional/settings/test_settings_wifi.py", line 24, in test_connect_to_wifi_via_settings_app
wifi_settings.connect_to_network(self.testvars['wifi'])
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.smoketest/tests/python/gaia-ui-tests/gaiatest/apps/settings/regions/wifi.py", line 44, in connect_to_network
password_input.send_keys(password)
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.smoketest/tests/python/gaia-ui-tests/.env/local/lib/python2.7/site-packages/marionette_client_mozilla_b2g37_v2_2-0.1-py2.7.egg/marionette/marionette.py", line 113, in send_keys
return self.marionette._send_message('sendKeysToElement', 'ok', id=self.id, value=typing)
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.smoketest/tests/python/gaia-ui-tests/.env/local/lib/python2.7/site-packages/marionette_client_mozilla_b2g37_v2_2-0.1-py2.7.egg/marionette/decorators.py", line 36, in _
return func(*args, **kwargs)
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.smoketest/tests/python/gaia-ui-tests/.env/local/lib/python2.7/site-packages/marionette_client_mozilla_b2g37_v2_2-0.1-py2.7.egg/marionette/marionette.py", line 634, in _send_message
self._handle_error(response)
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.smoketest/tests/python/gaia-ui-tests/.env/local/lib/python2.7/site-packages/marionette_client_mozilla_b2g37_v2_2-0.1-py2.7.egg/marionette/marionette.py", line 679, in _handle_error
raise errors.ElementNotVisibleException(message=message, status=status, stacktrace=stacktrace)
ElementNotVisibleException: ElementNotVisibleException: Element is not visible
Passed test_settings_usb_storage.TestUsbStorage test_toggle_usb_storage 60.6
Passed test_power_button_long_press.TestPowerButton test_power_button_long_press 54.6
Passed test_play_3gp_video.TestPlay3GPVideo test_play_3gp_video 60.8
Skipped test_call_log_all_calls.py 0
Bug 1096385 - Investigate failure in test_call_log_all_calls.py, call log is displayed erroneously
Skipped test_dialer_set_up_conference_call.py 0
Bug 1117813 - Make PlivoUtil use a valid 'answer_url' with a valid Plivo XML
Skipped test_setup_and_send_active_sync_email.py 0
Bug 1028192 - Problems with ActiveSync accounts
Skipped test_receive_active_sync_email.py 0
Bug 1028192 - Problems with ActiveSync accounts
Skipped test_fmradio_find_stations.py 0
Bug 1000863 - Investigate test_fmradio_find_stations.py failure
Skipped test_ftu_skip_tour_desktopb2g.py 0
skip-if: device != "desktop"
Skipped test_settings_cell_data.py 0
skip-if: device == "desktop" || device == "sp7710gaplus_gonk" || device == "flame"
Skipped test_browser_save_image.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_browser_navigation.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_browser_bookmark.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_browser_share_link.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_browser_clear_browsing_history.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_calendar_flick_through_months.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_camera_capture_photo.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_camera_flash_modes.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_camera_delete_captured_video.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_cards_view_kill_apps_with_two_apps.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_clock_set_alarm.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_call_contact.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_delete_all_contacts.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_default_contact_image.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_sort_contacts.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_delete_contact.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_add_contact_to_favorites.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_import_contacts_from_sim.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_export_contacts_to_sdcard.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_import_contacts_from_sdcard.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_import_contacts_from_gmail.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_sync_facebook_contacts.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_unlink_facebook.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_import_edit_export_contact.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_import_contacts_menu_no_network.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_import_gmail_no_network.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_cost_control_ftu.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_cost_control_reset_wifi.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_dialer_airplane_mode.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_MMI.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_clear_phone_number.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_dialer_add_contact.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_call_log_groups.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_delete_call_log.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_dialer_find_contact.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_dialer_miss_call_from_known_contact_notification.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_dialer_clear_miss_call_notification.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_dialer_receive_call_with_contact_photo.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_redial_last_number.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_dialer_dsds_make_phone_call_with_default_sim.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_dialer_dsds_receive_call_on_both_sims.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_rocketbar_search.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_rocketbar_offline_behavior.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_fmradio_add_remove_from_favorites.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_fmradio_turn_on_off.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_fmradio_airplane_mode.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_gallery_empty.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_gallery_delete_image.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_gallery_delete_multiple_images.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_gallery_cancel_delete_multiple_images.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_gallery_edit_photo.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_gallery_crop_photo.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_gallery_handle_invalid_file.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_gallery_handle_valid_image_file.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_gallery_share_picture.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_gallery_switch_to_camera.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_gallery_switch_to_camera_main_view.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_homescreen_column_layout.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_homescreen_change_wallpaper.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_homescreen_divider.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_homescreen_edit_mode.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_keyboard.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_number_keyboard.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_keyboard_predictive_key.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_email_keyboard.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_keyboard_bug_1073870.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_lockscreen_unlock_to_homescreen_with_passcode.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_lockscreen_unlock_to_emergency_call_screen.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_lockscreen_notification.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_lockscreen_wake_with_notification.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_add_to_an_existing_contact_from_messages.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_add_to_new_contact_from_messages.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_sms_add_contact.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_sms_to_dialer.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_sms_contact_match.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_sms_contact_input_validation.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_sms_notification.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_mms_add_subject.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_inbox_to_settings.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_sms_semicolon_completes_the_entered_recipient.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_sms_forward_sent_message.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_sms_auto_save_draft.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_music_album_mp3.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_music_empty.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_music_songs_3gp.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_music_change_rating.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_persona_app.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_findmydevice.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_settings_change_language.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_settings_change_language_rtl.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_settings_gps.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_settings_do_not_track.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_settings_dsds_cell_data.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_settings_airplane_mode.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_settings_media_storage.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_settings_wallpaper.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_settings_passcode.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_settings_change_keyboard_language.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_settings_device_info.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_settings_power_save_mode.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_settings_battery_power_save_mode.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_settings_sim_manager.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_settings_root.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_settings_change_ring_tone.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_system_notification_bar.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_geolocation_prompt.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_quick_settings.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_system_message.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_system_message_pending.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_inter_app_comm.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_privileged_app_audio_capture_prompt.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_privileged_app_video_capture_prompt.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_privileged_app_contacts_prompt.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_privileged_app_device_music_prompt.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_privileged_app_device_picture_prompt.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_privileged_app_device_sdcard_prompt.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_privileged_app_device_video_prompt.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_privileged_app_geolocation_prompt.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_video_empty.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_play_ogv_video.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_play_webm_video.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_play_mp4_video.py 0
filtered by type (b2g+smoketest-dsds)
Skipped test_play_ogg_video.py 0
filtered by type (b2g+smoketest-dsds)