Report generated on 27-Mar-2015 at 07:52:34 by gaiatest version 0.32

Configuration

Device firmware (base) L1TC100118D0
Device firmware (date) 26 Mar 2015 16:25:30
Device firmware (incremental) eng.cltbld.20150326.042521
Device firmware (release) 4.4.2
Device identifier flame
Gaia date 26 Mar 2015 08:02:53
Gaia revision e59ac067a1d2
Gecko build 20150326002504
Gecko revision 04b4b9d1faae
Gecko version 37.0

Summary

133 tests ran in 9455 seconds.
130 passed, 55 skipped, 1 failed, 2 errors.
0 expected failures, 0 unexpected passes.

Results

Result Class Test Name Duration Links
Passed test_browser_save_image.TestBrowserSaveImage test_browser_save_image 95.9
Passed test_browser_navigation.TestBrowserNavigation test_browser_back_button 86.2
Passed test_browser_bookmark.TestBrowserBookmark test_browser_bookmark 161.4
Passed test_browser_share_link.TestBrowserShareToMessages test_browser_share_to_messages 89.8
Passed test_browser_clear_browsing_history.TestBrowserClearHistory test_browser_clear_history 156.3
Passed test_calendar_flick_through_months.TestCalendar test_calendar_flick_through_months 56.7
Passed test_camera_capture_photo.TestCamera test_capture_a_photo 59.6
Passed test_camera_flash_modes.TestCameraFlashModes test_camera_flash_modes 66.0
Passed test_camera_delete_captured_video.TestPreviewDelete test_capture_and_delete_video 79.5
Passed test_cards_view_kill_apps_with_two_apps.TestCardsViewTwoApps test_kill_app_from_cards_view 65.6
Passed test_clock_set_alarm.TestClockSetAlarm test_clock_set_alarm 114.3
Passed test_call_contact.TestContacts test_call_contact 65.2
Passed test_delete_all_contacts.TestDeleteAllContacts test_delete_all_contacts 60.8
Passed test_default_contact_image.TestDefaultContactImage test_default_contact_image 61.4
Passed test_sort_contacts.TestContacts test_sort_contacts 74.1
Passed test_delete_contact.TestContacts test_delete_contact 89.5
Passed test_add_contact_to_favorites.TestAddContactToFavorite test_add_contact_to_favorite 61.0
Passed test_import_contacts_from_sim.TestImportContactsFromSIM test_import_contacts_from_SIM 77.2
Passed test_export_contacts_to_sdcard.TestExportContactsToSDCard test_export_contacts_to_sdcard 62.2
Passed test_import_contacts_from_sdcard.TestImportContactsFromSDCard test_import_contacts_from_sdcard 66.2
Passed test_import_contacts_from_gmail.TestImportContactsFromGmail test_import_contacts_from_gmail 90.7
Passed test_sync_facebook_contacts.TestImportContactsFromFacebook test_import_contacts_from_facebook 86.5
Passed test_unlink_facebook.TestContacts test_unlink_facebook_contact 85.7
Passed test_import_edit_export_contact.TestImportEditExportContact test_import_edit_export_contact 90.7
Passed test_import_contacts_menu_no_network.TestImportContactsMenuNoNetwork test_import_contacts_menu_no_network 63.3
Passed test_import_gmail_no_network.TestImportGMailNoNetwork test_import_gmail_no_network 86.6
Passed test_cost_control_ftu.TestCostControlFTU test_cost_control_ftu 74.0
Passed test_cost_control_reset_wifi.TestCostControlReset test_cost_control_reset_wifi 108.0
Passed test_dialer_airplane_mode.TestDialerAirplaneMode test_dialer_airplane_mode 68.5
Passed test_MMI.TestMMI test_MMI_code_IMEI 57.5
Passed test_clear_phone_number.TestClearPhoneNumber test_clear_phone_number 63.9
Passed test_dialer_add_contact.TestDialerAddContact test_dialer_add_contact 76.3
Failure test_call_log_groups.TestCallLogGroups test_call_log_groups 66.2
Traceback (most recent call last):
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.non-smoketest/tests/python/gaia-ui-tests/.env/local/lib/python2.7/site-packages/marionette_client-0.8.6-py2.7.egg/marionette/marionette_test.py", line 268, in run
testMethod()
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.non-smoketest/tests/python/gaia-ui-tests/gaiatest/tests/functional/dialer/test_call_log_groups.py", line 50, in test_call_log_groups
self.assertEqual('TODAY', group_calls[0].header_text)
AssertionError: 'TODAY' != u'12/01/2014'
Passed test_delete_call_log.TestDeleteCallLog test_delete_call_log 93.8
Passed test_dialer_find_contact.TestDialerFindContact test_dialer_find_contact 65.8
Passed test_dialer_miss_call_from_known_contact_notification.TestReceiveCallFromKnownContactNotification test_dialer_miss_call_from_known_contact_notification 81.7
Passed test_dialer_clear_miss_call_notification.TestDialerClearMissCallNotification test_dialer_clear_miss_call_notification 76.4
Passed test_dialer_receive_call_with_contact_photo.TestReceiveCallWithContactPhoto test_dialer_receive_call_with_contact_photo 65.2
Passed test_redial_last_number.TestRedialLastNumber test_redial_last_number 59.9
Passed test_rocketbar_search.TestRocketBarSearch test_launch_rocketbar_search 68.1
Passed test_rocketbar_offline_behavior.TestRocketBarOffline test_rocketbar_offline_behavior 65.0
Passed test_fmradio_add_remove_from_favorites.TestFMRadioAddRemoveFavorites test_add_remove_from_favorites 121.0
Passed test_fmradio_turn_on_off.TestFMRadioTurnOnOff test_turn_radio_on_off 66.8
Passed test_fmradio_airplane_mode.TestFMRadioAirplaneMode test_radio_airplane_mode 56.7
Passed test_gallery_empty.TestGalleryEmpty test_empty_gallery 52.5
Passed test_gallery_delete_image.TestGalleryDelete test_gallery_delete_image 57.8
Passed test_gallery_delete_multiple_images.TestGalleryMultiDelete test_gallery_delete_image 59.4
Passed test_gallery_cancel_delete_multiple_images.TestGalleryMultiDelete test_gallery_delete_image 59.3
Passed test_gallery_edit_photo.TestGalleryEditPhoto test_gallery_edit_photo 64.7
Passed test_gallery_crop_photo.TestGalleryCropPhoto test_gallery_crop_photo 62.0
Passed test_gallery_handle_invalid_file.TestGalleryHandleInvalidPhoto test_gallery_handle_load_corrupt_file_corrupt_jpg 54.9
Passed test_gallery_handle_invalid_file.TestGalleryHandleInvalidPhoto test_gallery_handle_load_corrupt_file_text_file 86.7
Passed test_gallery_handle_invalid_file.TestGalleryHandleInvalidPhoto test_gallery_handle_load_corrupt_file_truncated_bmp 85.5
Passed test_gallery_handle_invalid_file.TestGalleryHandleInvalidPhoto test_gallery_handle_load_corrupt_file_truncated_gif 87.2
Passed test_gallery_handle_invalid_file.TestGalleryHandleInvalidPhoto test_gallery_handle_load_corrupt_file_truncated_jpg 87.0
Passed test_gallery_handle_invalid_file.TestGalleryHandleInvalidPhoto test_gallery_handle_load_corrupt_file_truncated_png 83.7
Passed test_gallery_handle_invalid_file.TestGalleryHandleInvalidPhoto test_gallery_handle_load_corrupt_file_zero_length_file 85.2
Passed test_gallery_handle_valid_image_file.TestGalleryHandleValidPhoto test_gallery_open_valid_image_file_animated_gif 57.2
Passed test_gallery_handle_valid_image_file.TestGalleryHandleValidPhoto test_gallery_open_valid_image_file_animated_png 58.1
Passed test_gallery_handle_valid_image_file.TestGalleryHandleValidPhoto test_gallery_open_valid_image_file_load_bmp 57.1
Passed test_gallery_handle_valid_image_file.TestGalleryHandleValidPhoto test_gallery_open_valid_image_file_load_gif 58.9
Passed test_gallery_handle_valid_image_file.TestGalleryHandleValidPhoto test_gallery_open_valid_image_file_load_jpg 57.9
Passed test_gallery_handle_valid_image_file.TestGalleryHandleValidPhoto test_gallery_open_valid_image_file_load_png 56.9
Passed test_gallery_handle_valid_image_file.TestGalleryHandleValidPhoto test_gallery_open_valid_image_file_load_progressive_jpg 56.2
Passed test_gallery_handle_valid_image_file.TestGalleryHandleValidPhoto test_gallery_open_valid_image_file_load_transparent_background_png 58.2
Passed test_gallery_share_picture.TestGallerySharePicture test_gallery_share_to_messages 65.2
Passed test_gallery_switch_to_camera.TestGallery test_gallery_switch_to_camera 68.4
Passed test_gallery_switch_to_camera_main_view.TestGallery test_gallery_view 64.8
Passed test_homescreen_column_layout.TestHomescreenLayout test_homescreen_column_layout 69.6
Passed test_homescreen_change_wallpaper.TestHomescreenChangeWallpaper test_homescreen_change_wallpaper_from_gallery 65.4
Passed test_homescreen_divider.TestDivider test_create_delete_divider 71.3
Passed test_homescreen_edit_mode.TestEditMode test_access_and_leave_edit_mode 57.7
Error test_keyboard.TestKeyboard test_keyboard_basic 56.6
Traceback (most recent call last):
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.non-smoketest/tests/python/gaia-ui-tests/.env/local/lib/python2.7/site-packages/marionette_client-0.8.6-py2.7.egg/marionette/marionette_test.py", line 268, in run
testMethod()
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.non-smoketest/tests/python/gaia-ui-tests/gaiatest/tests/functional/keyboard/test_keyboard.py", line 22, in test_keyboard_basic
new_contact_form.type_phone(contact['tel']['value'])
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.non-smoketest/tests/python/gaia-ui-tests/gaiatest/apps/contacts/regions/contact_form.py", line 52, in type_phone
element.send_keys(value)
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.non-smoketest/tests/python/gaia-ui-tests/.env/local/lib/python2.7/site-packages/marionette_client-0.8.6-py2.7.egg/marionette/marionette.py", line 113, in send_keys
return self.marionette._send_message('sendKeysToElement', 'ok', id=self.id, value=typing)
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.non-smoketest/tests/python/gaia-ui-tests/.env/local/lib/python2.7/site-packages/marionette_client-0.8.6-py2.7.egg/marionette/decorators.py", line 36, in _
return func(*args, **kwargs)
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.non-smoketest/tests/python/gaia-ui-tests/.env/local/lib/python2.7/site-packages/marionette_client-0.8.6-py2.7.egg/marionette/marionette.py", line 634, in _send_message
self._handle_error(response)
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.non-smoketest/tests/python/gaia-ui-tests/.env/local/lib/python2.7/site-packages/marionette_client-0.8.6-py2.7.egg/marionette/marionette.py", line 679, in _handle_error
raise errors.ElementNotVisibleException(message=message, status=status, stacktrace=stacktrace)
ElementNotVisibleException: ElementNotVisibleException: Element is not visible
Passed test_number_keyboard.TestNumberKeyboard test_number_keyboard 60.0
Passed test_keyboard_predictive_key.TestKeyboardPredictiveKey test_keyboard_predictive_key 79.4
Passed test_email_keyboard.TestEmailKeyboard test_basic_email_keyboard 68.4
Passed test_keyboard_bug_1073870.TestKeyboardBug1073870 test_keyboard_bug_1073870 66.4
Passed test_lockscreen_unlock_to_homescreen_with_passcode.TestLockScreen test_unlock_to_homescreen_with_passcode 61.7
Passed test_lockscreen_unlock_to_emergency_call_screen.TestLockScreen test_unlock_to_emergency_call_screen 58.9
Passed test_lockscreen_notification.TestLockScreen test_lock_screen_notification 57.3
Passed test_lockscreen_wake_with_notification.TestLockScreenNotification test_lock_screen_wake_with_notification 58.0
Passed test_add_to_an_existing_contact_from_messages.TestSmsAddToExistingContact test_sms_add_number_to_existing_contact 76.9
Passed test_add_to_new_contact_from_messages.TestSmsCreateContact test_sms_create_new_contact 90.8
Passed test_sms_add_contact.TestSmsAddContact test_sms_add_contact 78.7
Passed test_sms_to_dialer.TestDialerFromMessage test_dialer_from_message 64.1
Passed test_sms_contact_match.TestContactMatch test_contact_match 69.2
Passed test_sms_contact_input_validation.TestContactValidation test_sms_contact_validation 73.9
Error test_sms_notification.TestSmsNotification test_sms_notification 58.4
Traceback (most recent call last):
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.non-smoketest/tests/python/gaia-ui-tests/.env/local/lib/python2.7/site-packages/marionette_client-0.8.6-py2.7.egg/marionette/marionette_test.py", line 268, in run
testMethod()
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.non-smoketest/tests/python/gaia-ui-tests/gaiatest/tests/functional/messages/test_sms_notification.py", line 26, in test_sms_notification
message="Notification did not appear. SMS database dump: %s " % self.data_layer.get_all_sms())
TypeError: wait_for_notification_toaster_displayed() got an unexpected keyword argument 'message'
Passed test_mms_add_subject.TestMmsAddSubject test_mms_add_subject 63.2
Passed test_inbox_to_settings.TestSettingsFromInbox test_settings_from_inbox 63.0
Passed test_sms_semicolon_completes_the_entered_recipient.TestSMSContactInput test_sms_semicolon_completes_the_entered_recipient 67.3
Passed test_sms_forward_sent_message.TestSmsForwardMessage test_sms_forward_sent_message 78.0
Passed test_sms_auto_save_draft.TestSmsAutoSaveDrafts test_sms_auto_save_draft 83.5
Passed test_music_album_mp3.TestMusic test_select_album_play 67.3
Passed test_music_empty.TestMusicEmpty test_empty_music 56.0
Passed test_music_songs_3gp.TestPlay3GPMusic test_select_songs_play_3gp_file 67.7
Passed test_music_change_rating.TestSetMusicRating test_music_change_rating 63.1
Passed test_persona_app.TestPersonaStandard test_persona_standard_sign_in 111.4
Passed test_findmydevice.TestSettingsFindMyDevice test_findmydevice 75.2
Passed test_settings_change_language.TestChangeLanguage test_change_language_settings 67.7
Passed test_settings_change_language_rtl.TestChangeLanguageRTL test_change_language_settings_rtl 69.5
Passed test_settings_gps.TestSettingsGPS test_enable_gps_via_settings_app 57.4
Passed test_settings_do_not_track.TestSettingsDoNotTrack test_enable_do_not_track_via_settings_app 65.1
Passed test_settings_dsds_cell_data.TestDSDSCellData test_cell_data_for_two_sims 66.6
Passed test_settings_airplane_mode.TestAirplaneMode test_toggle_airplane_mode 73.8
Passed test_settings_media_storage.TestSettingsMediaStorage test_settings_media_storage 70.5
Passed test_settings_wallpaper.TestWallpaper test_change_wallpaper 66.6
Passed test_settings_passcode.TestSettingsPasscode test_set_passcode_by_settings 67.4
Passed test_settings_change_keyboard_language.TestChangeKeyboardLanguage test_change_keyboard_language_settings 69.0
Passed test_settings_device_info.TestSettingsDeviceInfo test_that_device_info_is_populated 62.8
Passed test_settings_power_save_mode.TestPowerSaveMode test_power_save_mode 71.2
Passed test_settings_battery_power_save_mode.TestBatteryPowerSaveMode test_settings_battery_power_save_mode 74.5
Passed test_settings_root.TestSettingsRoot test_settings_root_items 61.6
Passed test_settings_change_ring_tone.TestSettingsChangeRingTone test_settings_change_ring_tone 73.0
Passed test_system_notification_bar.TestNotificationBar test_notification_bar 117.5
Passed test_geolocation_prompt.TestGeolocationPrompt test_geolocation_prompt 57.9
Passed test_quick_settings.TestQuickSettingsButton test_quick_settings_button 54.5
Passed test_system_message.TestSystemMessage test_app_launched_by_system_message 54.7
Passed test_system_message_pending.TestSystemMessage test_pending_system_message 53.2
Passed test_inter_app_comm.TestInterAppComm test_inter_app_comm 60.8
Passed test_privileged_app_audio_capture_prompt.TestPrivilegedAppAudioCapturePrompt test_audio_capture_prompt 56.3
Passed test_privileged_app_video_capture_prompt.TestPrivilegedAppVideoCapturePrompt test_video_capture_prompt 57.6
Passed test_privileged_app_contacts_prompt.TestPrivilegedAppContactsPrompt test_contact_prompt 60.1
Passed test_privileged_app_device_music_prompt.TestPrivilegedAppDeviceMusicPrompt test_get_music_prompt 60.0
Passed test_privileged_app_device_picture_prompt.TestPrivilegedAppDevicePicturePrompt test_get_pictures_prompt 59.2
Passed test_privileged_app_device_sdcard_prompt.TestPrivilegedAppDeviceSDcardPrompt test_get_sdcard_prompt 57.2
Passed test_privileged_app_device_video_prompt.TestPrivilegedAppDeviceVideoPrompt test_get_videos_prompt 57.1
Passed test_privileged_app_geolocation_prompt.TestPrivilegedAppGeolocationPrompt test_geolocation_prompt 59.1
Passed test_video_empty.TestVideoEmpty test_empty_video 56.2
Passed test_play_ogv_video.TestPlayOgvVideo test_play_ogv_video 58.5
Passed test_play_webm_video.TestPlayWebMVideo test_play_webm_video 61.6
Passed test_play_mp4_video.TestPlayMP4Video test_play_mp4_video 61.6
Passed test_play_ogg_video.TestPlayOGGVideo test_play_ogg_video 59.8
Skipped test_cost_control_data_alert_mobile.py 0
Bug 1115180 for getting it re-enabled
Skipped test_call_log_all_calls.py 0
Bug 1096385 - Investigate failure in test_call_log_all_calls.py, call log is displayed erroneously
Skipped test_dialer_set_up_conference_call.py 0
Bug 1117813 - Make PlivoUtil use a valid 'answer_url' with a valid Plivo XML
Skipped test_setup_and_send_active_sync_email.py 0
Bug 1028192 - Problems with ActiveSync accounts
Skipped test_receive_active_sync_email.py 0
Bug 1028192 - Problems with ActiveSync accounts
Skipped test_fmradio_find_stations.py 0
Bug 1000863 - Investigate test_fmradio_find_stations.py failure
Skipped test_ftu_skip_tour_desktopb2g.py 0
skip-if: device != "desktop"
Skipped test_settings_cell_data.py 0
skip-if: device == "desktop" || device == "sp7710gaplus_gonk" || device == "flame"
Skipped test_browser_cell_data.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_browser_lan.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_browser_play_video.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_calendar_new_event_appears_on_all_calendar_views.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_camera_capture_video.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_camera_multiple_shots.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_cards_view_with_two_apps.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_clock_create_new_alarm.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_add_new_contact.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_edit_contact.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_sms_contact.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_add_photo_to_contact.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_dialer.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_dialer_receive_call.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_dialer_receive_call_with_locked_screen.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_dialer_dsds_make_phone_call_with_default_sim.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_dialer_dsds_receive_call_on_both_sims.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_setup_basic_gmail.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_setup_and_send_imap_email.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_IMAP_email_notification.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_rocketbar_add_collection_save_bookmark.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_fmradio_frequency_dialer.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_ftu_skip_tour.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_ftu_with_tour.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_ftu_status_bar.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_gallery_view.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_gallery_flick.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_homescreen_delete_app.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_homescreen_delete_app_packaged.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_homescreen_launch_app.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_homescreen_launch_app_packaged.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_homescreen_move_app.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_lockscreen_unlock_to_homescreen.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_lockscreen_unlock_to_camera.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_lockscreen_unlock_to_camera_with_passcode.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_marketplace_launch.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_marketplace_packaged_app.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_sms.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_sms_with_attachments.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_sms_with_picture_attached.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_music_artist_mp3.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_settings_bluetooth.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_settings_wifi.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_settings_sim_manager.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_settings_usb_storage.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_power_button_long_press.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_play_3gp_video.py 0
filtered by type (b2g-smoketest-dsds)