Report generated on 30-Mar-2015 at 07:57:16 by gaiatest version 0.32

Configuration

Device firmware (base) L1TC100118D0
Device firmware (date) 29 Mar 2015 15:55:05
Device firmware (incremental) eng.cltbld.20150329.035453
Device firmware (release) 4.4.2
Device identifier flame
Gaia date 28 Mar 2015 04:14:43
Gaia revision 473cd63f53c8
Gecko build 20150329002502
Gecko revision 4b13c4254e2f
Gecko version 37.0

Summary

133 tests ran in 9736 seconds.
130 passed, 55 skipped, 2 failed, 1 errors.
0 expected failures, 0 unexpected passes.

Results

Result Class Test Name Duration Links
Passed test_browser_save_image.TestBrowserSaveImage test_browser_save_image 99.5
Passed test_browser_navigation.TestBrowserNavigation test_browser_back_button 88.2
Passed test_browser_bookmark.TestBrowserBookmark test_browser_bookmark 165.1
Passed test_browser_share_link.TestBrowserShareToMessages test_browser_share_to_messages 94.9
Passed test_browser_clear_browsing_history.TestBrowserClearHistory test_browser_clear_history 156.2
Passed test_calendar_flick_through_months.TestCalendar test_calendar_flick_through_months 58.7
Passed test_camera_capture_photo.TestCamera test_capture_a_photo 62.6
Passed test_camera_flash_modes.TestCameraFlashModes test_camera_flash_modes 68.4
Passed test_camera_delete_captured_video.TestPreviewDelete test_capture_and_delete_video 81.6
Passed test_cards_view_kill_apps_with_two_apps.TestCardsViewTwoApps test_kill_app_from_cards_view 65.8
Passed test_clock_set_alarm.TestClockSetAlarm test_clock_set_alarm 118.0
Passed test_call_contact.TestContacts test_call_contact 67.2
Passed test_delete_all_contacts.TestDeleteAllContacts test_delete_all_contacts 64.9
Passed test_default_contact_image.TestDefaultContactImage test_default_contact_image 62.8
Passed test_sort_contacts.TestContacts test_sort_contacts 78.8
Passed test_delete_contact.TestContacts test_delete_contact 93.2
Passed test_add_contact_to_favorites.TestAddContactToFavorite test_add_contact_to_favorite 63.6
Passed test_import_contacts_from_sim.TestImportContactsFromSIM test_import_contacts_from_SIM 78.5
Passed test_export_contacts_to_sdcard.TestExportContactsToSDCard test_export_contacts_to_sdcard 65.1
Passed test_import_contacts_from_sdcard.TestImportContactsFromSDCard test_import_contacts_from_sdcard 70.7
Passed test_import_contacts_from_gmail.TestImportContactsFromGmail test_import_contacts_from_gmail 94.5
Passed test_sync_facebook_contacts.TestImportContactsFromFacebook test_import_contacts_from_facebook 91.2
Passed test_unlink_facebook.TestContacts test_unlink_facebook_contact 89.8
Passed test_import_edit_export_contact.TestImportEditExportContact test_import_edit_export_contact 93.5
Passed test_import_contacts_menu_no_network.TestImportContactsMenuNoNetwork test_import_contacts_menu_no_network 66.7
Passed test_import_gmail_no_network.TestImportGMailNoNetwork test_import_gmail_no_network 90.7
Passed test_cost_control_ftu.TestCostControlFTU test_cost_control_ftu 75.3
Passed test_cost_control_reset_wifi.TestCostControlReset test_cost_control_reset_wifi 115.2
Passed test_dialer_airplane_mode.TestDialerAirplaneMode test_dialer_airplane_mode 69.8
Passed test_MMI.TestMMI test_MMI_code_IMEI 60.2
Passed test_clear_phone_number.TestClearPhoneNumber test_clear_phone_number 67.3
Passed test_dialer_add_contact.TestDialerAddContact test_dialer_add_contact 78.7
Failure test_call_log_groups.TestCallLogGroups test_call_log_groups 68.7 Source Screenshot Settings
Traceback (most recent call last):
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.non-smoketest/tests/python/gaia-ui-tests/.env/local/lib/python2.7/site-packages/marionette_client-0.8.6-py2.7.egg/marionette/marionette_test.py", line 268, in run
testMethod()
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.non-smoketest/tests/python/gaia-ui-tests/gaiatest/tests/functional/dialer/test_call_log_groups.py", line 50, in test_call_log_groups
self.assertEqual('TODAY', group_calls[0].header_text)
AssertionError: 'TODAY' != u'12/01/2014'
Passed test_delete_call_log.TestDeleteCallLog test_delete_call_log 93.9
Passed test_dialer_find_contact.TestDialerFindContact test_dialer_find_contact 68.2
Passed test_dialer_miss_call_from_known_contact_notification.TestReceiveCallFromKnownContactNotification test_dialer_miss_call_from_known_contact_notification 79.7
Passed test_dialer_clear_miss_call_notification.TestDialerClearMissCallNotification test_dialer_clear_miss_call_notification 80.1
Passed test_dialer_receive_call_with_contact_photo.TestReceiveCallWithContactPhoto test_dialer_receive_call_with_contact_photo 64.0
Passed test_redial_last_number.TestRedialLastNumber test_redial_last_number 60.6
Passed test_rocketbar_search.TestRocketBarSearch test_launch_rocketbar_search 67.0
Passed test_rocketbar_offline_behavior.TestRocketBarOffline test_rocketbar_offline_behavior 66.4
Passed test_fmradio_add_remove_from_favorites.TestFMRadioAddRemoveFavorites test_add_remove_from_favorites 124.1
Passed test_fmradio_turn_on_off.TestFMRadioTurnOnOff test_turn_radio_on_off 67.8
Passed test_fmradio_airplane_mode.TestFMRadioAirplaneMode test_radio_airplane_mode 55.1
Passed test_gallery_empty.TestGalleryEmpty test_empty_gallery 56.4
Passed test_gallery_delete_image.TestGalleryDelete test_gallery_delete_image 61.0
Passed test_gallery_delete_multiple_images.TestGalleryMultiDelete test_gallery_delete_image 63.2
Passed test_gallery_cancel_delete_multiple_images.TestGalleryMultiDelete test_gallery_delete_image 60.2
Passed test_gallery_edit_photo.TestGalleryEditPhoto test_gallery_edit_photo 68.3
Passed test_gallery_crop_photo.TestGalleryCropPhoto test_gallery_crop_photo 64.6
Passed test_gallery_handle_invalid_file.TestGalleryHandleInvalidPhoto test_gallery_handle_load_corrupt_file_corrupt_jpg 60.3
Passed test_gallery_handle_invalid_file.TestGalleryHandleInvalidPhoto test_gallery_handle_load_corrupt_file_text_file 85.0
Passed test_gallery_handle_invalid_file.TestGalleryHandleInvalidPhoto test_gallery_handle_load_corrupt_file_truncated_bmp 85.6
Passed test_gallery_handle_invalid_file.TestGalleryHandleInvalidPhoto test_gallery_handle_load_corrupt_file_truncated_gif 87.1
Passed test_gallery_handle_invalid_file.TestGalleryHandleInvalidPhoto test_gallery_handle_load_corrupt_file_truncated_jpg 88.8
Passed test_gallery_handle_invalid_file.TestGalleryHandleInvalidPhoto test_gallery_handle_load_corrupt_file_truncated_png 88.1
Passed test_gallery_handle_invalid_file.TestGalleryHandleInvalidPhoto test_gallery_handle_load_corrupt_file_zero_length_file 87.9
Passed test_gallery_handle_valid_image_file.TestGalleryHandleValidPhoto test_gallery_open_valid_image_file_animated_gif 58.7
Passed test_gallery_handle_valid_image_file.TestGalleryHandleValidPhoto test_gallery_open_valid_image_file_animated_png 58.1
Passed test_gallery_handle_valid_image_file.TestGalleryHandleValidPhoto test_gallery_open_valid_image_file_load_bmp 60.1
Passed test_gallery_handle_valid_image_file.TestGalleryHandleValidPhoto test_gallery_open_valid_image_file_load_gif 58.4
Passed test_gallery_handle_valid_image_file.TestGalleryHandleValidPhoto test_gallery_open_valid_image_file_load_jpg 58.0
Passed test_gallery_handle_valid_image_file.TestGalleryHandleValidPhoto test_gallery_open_valid_image_file_load_png 58.1
Passed test_gallery_handle_valid_image_file.TestGalleryHandleValidPhoto test_gallery_open_valid_image_file_load_progressive_jpg 59.9
Passed test_gallery_handle_valid_image_file.TestGalleryHandleValidPhoto test_gallery_open_valid_image_file_load_transparent_background_png 58.2
Passed test_gallery_share_picture.TestGallerySharePicture test_gallery_share_to_messages 68.2
Passed test_gallery_switch_to_camera.TestGallery test_gallery_switch_to_camera 71.9
Passed test_gallery_switch_to_camera_main_view.TestGallery test_gallery_view 65.8
Passed test_homescreen_column_layout.TestHomescreenLayout test_homescreen_column_layout 72.9
Passed test_homescreen_change_wallpaper.TestHomescreenChangeWallpaper test_homescreen_change_wallpaper_from_gallery 65.7
Passed test_homescreen_divider.TestDivider test_create_delete_divider 69.5
Passed test_homescreen_edit_mode.TestEditMode test_access_and_leave_edit_mode 62.0
Passed test_keyboard.TestKeyboard test_keyboard_basic 97.0
Passed test_number_keyboard.TestNumberKeyboard test_number_keyboard 63.6
Failure test_keyboard_predictive_key.TestKeyboardPredictiveKey test_keyboard_predictive_key 78.9 Source Screenshot Settings
Traceback (most recent call last):
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.non-smoketest/tests/python/gaia-ui-tests/.env/local/lib/python2.7/site-packages/marionette_client-0.8.6-py2.7.egg/marionette/marionette_test.py", line 268, in run
testMethod()
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.non-smoketest/tests/python/gaia-ui-tests/gaiatest/tests/functional/keyboard/test_keyboard_predictive_key.py", line 69, in test_keyboard_predictive_key
self.assertEqual(keyboard_page.text_input, 'keyboard Tea he wit.')
AssertionError: u'keyboard Tea he wot.' != 'keyboard Tea he wit.'
Passed test_email_keyboard.TestEmailKeyboard test_basic_email_keyboard 69.9
Passed test_keyboard_bug_1073870.TestKeyboardBug1073870 test_keyboard_bug_1073870 68.3
Passed test_lockscreen_unlock_to_homescreen_with_passcode.TestLockScreen test_unlock_to_homescreen_with_passcode 62.1
Passed test_lockscreen_unlock_to_emergency_call_screen.TestLockScreen test_unlock_to_emergency_call_screen 61.2
Passed test_lockscreen_notification.TestLockScreen test_lock_screen_notification 56.4
Passed test_lockscreen_wake_with_notification.TestLockScreenNotification test_lock_screen_wake_with_notification 60.1
Passed test_add_to_an_existing_contact_from_messages.TestSmsAddToExistingContact test_sms_add_number_to_existing_contact 77.0
Passed test_add_to_new_contact_from_messages.TestSmsCreateContact test_sms_create_new_contact 91.4
Passed test_sms_add_contact.TestSmsAddContact test_sms_add_contact 82.5
Passed test_sms_to_dialer.TestDialerFromMessage test_dialer_from_message 67.7
Passed test_sms_contact_match.TestContactMatch test_contact_match 69.2
Passed test_sms_contact_input_validation.TestContactValidation test_sms_contact_validation 75.7
Error test_sms_notification.TestSmsNotification test_sms_notification 58.6 Source Screenshot Settings
Traceback (most recent call last):
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.non-smoketest/tests/python/gaia-ui-tests/.env/local/lib/python2.7/site-packages/marionette_client-0.8.6-py2.7.egg/marionette/marionette_test.py", line 268, in run
testMethod()
File "/var/lib/jenkins/workspace/B2G.v2.2.pvt.flame.gaiatest.non-smoketest/tests/python/gaia-ui-tests/gaiatest/tests/functional/messages/test_sms_notification.py", line 26, in test_sms_notification
message="Notification did not appear. SMS database dump: %s " % self.data_layer.get_all_sms())
TypeError: wait_for_notification_toaster_displayed() got an unexpected keyword argument 'message'
Passed test_mms_add_subject.TestMmsAddSubject test_mms_add_subject 61.2
Passed test_inbox_to_settings.TestSettingsFromInbox test_settings_from_inbox 60.3
Passed test_sms_semicolon_completes_the_entered_recipient.TestSMSContactInput test_sms_semicolon_completes_the_entered_recipient 69.1
Passed test_sms_forward_sent_message.TestSmsForwardMessage test_sms_forward_sent_message 80.7
Passed test_sms_auto_save_draft.TestSmsAutoSaveDrafts test_sms_auto_save_draft 83.5
Passed test_music_album_mp3.TestMusic test_select_album_play 68.0
Passed test_music_empty.TestMusicEmpty test_empty_music 57.5
Passed test_music_songs_3gp.TestPlay3GPMusic test_select_songs_play_3gp_file 65.0
Passed test_music_change_rating.TestSetMusicRating test_music_change_rating 65.7
Passed test_persona_app.TestPersonaStandard test_persona_standard_sign_in 113.9
Passed test_findmydevice.TestSettingsFindMyDevice test_findmydevice 75.0
Passed test_settings_change_language.TestChangeLanguage test_change_language_settings 68.3
Passed test_settings_change_language_rtl.TestChangeLanguageRTL test_change_language_settings_rtl 68.5
Passed test_settings_gps.TestSettingsGPS test_enable_gps_via_settings_app 58.7
Passed test_settings_do_not_track.TestSettingsDoNotTrack test_enable_do_not_track_via_settings_app 64.3
Passed test_settings_dsds_cell_data.TestDSDSCellData test_cell_data_for_two_sims 66.1
Passed test_settings_airplane_mode.TestAirplaneMode test_toggle_airplane_mode 76.3
Passed test_settings_media_storage.TestSettingsMediaStorage test_settings_media_storage 70.7
Passed test_settings_wallpaper.TestWallpaper test_change_wallpaper 65.5
Passed test_settings_passcode.TestSettingsPasscode test_set_passcode_by_settings 68.5
Passed test_settings_change_keyboard_language.TestChangeKeyboardLanguage test_change_keyboard_language_settings 73.3
Passed test_settings_device_info.TestSettingsDeviceInfo test_that_device_info_is_populated 65.0
Passed test_settings_power_save_mode.TestPowerSaveMode test_power_save_mode 71.4
Passed test_settings_battery_power_save_mode.TestBatteryPowerSaveMode test_settings_battery_power_save_mode 74.1
Passed test_settings_root.TestSettingsRoot test_settings_root_items 63.1
Passed test_settings_change_ring_tone.TestSettingsChangeRingTone test_settings_change_ring_tone 76.3
Passed test_system_notification_bar.TestNotificationBar test_notification_bar 119.4
Passed test_geolocation_prompt.TestGeolocationPrompt test_geolocation_prompt 60.2
Passed test_quick_settings.TestQuickSettingsButton test_quick_settings_button 54.5
Passed test_system_message.TestSystemMessage test_app_launched_by_system_message 55.9
Passed test_system_message_pending.TestSystemMessage test_pending_system_message 54.9
Passed test_inter_app_comm.TestInterAppComm test_inter_app_comm 61.0
Passed test_privileged_app_audio_capture_prompt.TestPrivilegedAppAudioCapturePrompt test_audio_capture_prompt 60.0
Passed test_privileged_app_video_capture_prompt.TestPrivilegedAppVideoCapturePrompt test_video_capture_prompt 60.8
Passed test_privileged_app_contacts_prompt.TestPrivilegedAppContactsPrompt test_contact_prompt 61.9
Passed test_privileged_app_device_music_prompt.TestPrivilegedAppDeviceMusicPrompt test_get_music_prompt 60.2
Passed test_privileged_app_device_picture_prompt.TestPrivilegedAppDevicePicturePrompt test_get_pictures_prompt 63.7
Passed test_privileged_app_device_sdcard_prompt.TestPrivilegedAppDeviceSDcardPrompt test_get_sdcard_prompt 59.2
Passed test_privileged_app_device_video_prompt.TestPrivilegedAppDeviceVideoPrompt test_get_videos_prompt 59.8
Passed test_privileged_app_geolocation_prompt.TestPrivilegedAppGeolocationPrompt test_geolocation_prompt 61.7
Passed test_video_empty.TestVideoEmpty test_empty_video 56.5
Passed test_play_ogv_video.TestPlayOgvVideo test_play_ogv_video 62.8
Passed test_play_webm_video.TestPlayWebMVideo test_play_webm_video 62.0
Passed test_play_mp4_video.TestPlayMP4Video test_play_mp4_video 65.7
Passed test_play_ogg_video.TestPlayOGGVideo test_play_ogg_video 63.6
Skipped test_cost_control_data_alert_mobile.py 0
Bug 1115180 for getting it re-enabled
Skipped test_call_log_all_calls.py 0
Bug 1096385 - Investigate failure in test_call_log_all_calls.py, call log is displayed erroneously
Skipped test_dialer_set_up_conference_call.py 0
Bug 1117813 - Make PlivoUtil use a valid 'answer_url' with a valid Plivo XML
Skipped test_setup_and_send_active_sync_email.py 0
Bug 1028192 - Problems with ActiveSync accounts
Skipped test_receive_active_sync_email.py 0
Bug 1028192 - Problems with ActiveSync accounts
Skipped test_fmradio_find_stations.py 0
Bug 1000863 - Investigate test_fmradio_find_stations.py failure
Skipped test_ftu_skip_tour_desktopb2g.py 0
skip-if: device != "desktop"
Skipped test_settings_cell_data.py 0
skip-if: device == "desktop" || device == "sp7710gaplus_gonk" || device == "flame"
Skipped test_browser_cell_data.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_browser_lan.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_browser_play_video.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_calendar_new_event_appears_on_all_calendar_views.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_camera_capture_video.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_camera_multiple_shots.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_cards_view_with_two_apps.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_clock_create_new_alarm.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_add_new_contact.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_edit_contact.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_sms_contact.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_add_photo_to_contact.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_dialer.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_dialer_receive_call.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_dialer_receive_call_with_locked_screen.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_dialer_dsds_make_phone_call_with_default_sim.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_dialer_dsds_receive_call_on_both_sims.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_setup_basic_gmail.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_setup_and_send_imap_email.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_IMAP_email_notification.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_rocketbar_add_collection_save_bookmark.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_fmradio_frequency_dialer.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_ftu_skip_tour.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_ftu_with_tour.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_ftu_status_bar.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_gallery_view.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_gallery_flick.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_homescreen_delete_app.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_homescreen_delete_app_packaged.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_homescreen_launch_app.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_homescreen_launch_app_packaged.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_homescreen_move_app.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_lockscreen_unlock_to_homescreen.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_lockscreen_unlock_to_camera.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_lockscreen_unlock_to_camera_with_passcode.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_marketplace_launch.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_marketplace_packaged_app.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_sms.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_sms_with_attachments.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_sms_with_picture_attached.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_music_artist_mp3.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_settings_bluetooth.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_settings_wifi.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_settings_sim_manager.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_settings_usb_storage.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_power_button_long_press.py 0
filtered by type (b2g-smoketest-dsds)
Skipped test_play_3gp_video.py 0
filtered by type (b2g-smoketest-dsds)