スポンサーリンク

mablからダウンロード/エクスポートできるものを調べてみた #mabljapan

Selenium IDE exportに「not worry about vendor lock-in when using mabl.」とあるように、mablは基本的にいろんなものをダウンロード/エクスポートできます。それぞれどういうものかをみてみましょう。基本CSV形式です。

スポンサーリンク

Planのダウンロード

"APPLICATION_ID","APPLICATION_NAME","DEPLOYMENT_ID","PLAN_ID","PLAN_NAME","PLAN_RUN_ID","PLAN_URL","RUNTIME_MILLIS","STARTING_URL","START_TIME","STATUS","STOP_TIME","SUCCESS","TAGS","TRIGGER_TYPE","TRIGGER_USER_EMAIL","TRIGGER_USER_ID","WORKSPACE_ID","WORKSPACE_NAME"
"XXXX","mabl sandbox","YYYY","ZZZZ","mabl  sandbox plan","AAAAA","https://app.mabl.com/FFFFFF/test/plans/AAAA","81306","https://sandbox.mabl.com/","1583035204303","succeeded","1583035285609","false","","mabl_scheduler","","v1_8","GGGGG","daipresents workspace"
"XXXX","mabl sandbox","YYYY","ZZZZ","mabl  sandbox plan","BBBBB","https://app.mabl.com/FFFFFF/test/plans/AAAA","74473","https://sandbox.mabl.com/","1582948764871","succeeded","1582948839344","false","","mabl_scheduler","daipresents","GGGGG","EEEE","daipresents workspace"
  • “APPLICATION_ID”
  • “APPLICATION_NAME”
  • “DEPLOYMENT_ID”
  • “PLAN_ID”
  • “PLAN_NAME”
  • “PLAN_RUN_ID”
  • “PLAN_URL”
  • “RUNTIME_MILLIS”
  • “STARTING_URL”
  • “START_TIME”
  • “STATUS”
  • “STOP_TIME”
  • “SUCCESS”
  • “TAGS”
  • “TRIGGER_TYPE”
  • “TRIGGER_USER_EMAIL”
  • “TRIGGER_USER_ID”
  • “WORKSPACE_ID”
  • “WORKSPACE_NAME”

テストケース一覧のダウンロード

"id","journey","percentagePassed","planCount","createdBy","createdDate","description"
"XXXXXXXXXXXXXXXXXXX","Custom HTTP Header の確認","100","1","Dai Fujihara","Feb 10, 2020","Custom HTTP Headerの確認。JSからのアクセス(navigator.userAgent)と HTTPヘッダの中身を確認しています。
参考:https://daipresents.com/2020/creating-mobile-web-tests/"
"YYYYYYYYYYYYYYYYYYY","API request and response validation / APIのテスト","100","1","Dai Fujihara","Jan 30, 2020","APIを叩いてそのレスポンスをチェックしています。これによってテストデータをAPI経由で準備したり、データの状態を変更してテストを進められるためテストが簡潔になります。
参考: https://daipresents.com/2020/mabl-api-requests-response-validation/"
"ZZZZZZZZZZZZZZZZZZZZZ","Mobile View - モバイルページの確認","100","1","Dai Fujihara","Jan 29, 2020","レスポンシブルページをモバイルブラウザで表示します。mablではCustom HTTP HeaderやViewportの設定が可能です。
参考:https://daipresents.com/2020/creating-mobile-web-tests/
"
"DEFAULTTTTTTTTTTTTTTT","Visit all linked pages within the app","70","3","Dai Fujihara","Jan 7, 2020","Starting at the primary url, crawl all links within the application's domain, validate that the linked pages load."
"DEFAULTTTTTTTTTTTTTTT","Visit home page","100","3","Dai Fujihara","Jan 7, 2020","Attempt to load the primary url in a browser, validate that it loads, verify that login works (if provided)."
  • “id”
  • “journey”
  • “percentagePassed”
  • “planCount”
  • “createdBy”
  • “createdDate”
  • “description”

テストケースのダウンロード

"stepNumber","step"
"{""stepNumber"":1,""selectorId"":null}","Set viewport size to width 1538"
"{""stepNumber"":2,""selectorId"":null}","Visit URL assigned to variable ""app.url"""
"{""stepNumber"":3,""selectorId"":""9c6b25e3-8635-4d07-9107-XXXXXXXXXXXX""}","Assert ""innerText"" of the <h3> element with text ""Welcome to the mabl sandbox!"" equals ""Welcome to the mabl sandbox!"""
"{""stepNumber"":4,""selectorId"":""7969eb52-ef3c-46c3-a8bf-XXXXXXXXXXXX""}","Click on the <span> element with text ""DOWNLOADS AND PDFS"""
"{""stepNumber"":5,""selectorId"":""9da23b05-fea3-429e-89e3-XXXXXXXXXXXX""}","Click on the <span> element with text ""Download PDF"""
"{""stepNumber"":6,""selectorId"":""cbfee5e8-16c1-48ee-ae36-XXXXXXXXXXXX""}","Click on the <span> element with text ""Embedded PDF"""
"{""stepNumber"":7,""selectorId"":""46f85797-e659-4d2f-b2b8-XXXXXXXXXXXX""}","Switch context to the mabl PDF viewer"
"{""stepNumber"":8,""selectorId"":""6d368b31-e55d-4c10-9113-XXXXXXXXXXXX""}","Assert ""innerText"" of the <div> element with text ""1040"" equals ""1040"""
  • “stepNumber”
  • “step”
  • selectorId など

Selenium IDE形式はSelenium IDE形式などテストケースのエクスポートも簡単にできちゃう。そうmabl CLIならねを参考にどうぞ。

テスト結果一覧のダウンロード

"browser","status","failureReason","journey","labels","plan","environment","startedTime","runTime"
"chrome","completed","no failure reason available","Visit home page","default, smoke","Verify home page load and login - ホームページのロードとログイン (daipresents.com)","Production","Today at 10:51 PM","00:00:53"
"chrome","completed","no failure reason available","Visit home page","default, smoke","Verify home page load and login - ホームページのロードとログイン (daipresents.com)","Production","Today at 6:51 PM","00:00:44"
"chrome","completed","no failure reason available","Visit home page","default, smoke","Verify home page load and login - ホームページのロードとログイン (daipresents.com)","Production","Today at 2:51 PM","00:00:47"
"chrome","completed","no failure reason available","PDF download  / PDFダウンロード","training","mabl  sandbox plan","Production","Today at 1:00 PM","00:01:00"
"chrome","completed","no failure reason available","Email validation / Emailバリデーション","training","mabl  sandbox plan","Production","Today at 1:00 PM","00:01:15"
  • “browser”
  • “status”
  • “failureReason”
  • “journey”
  • “labels”
  • “plan”
  • “environment”
  • “startedTime”
  • “runTime”

テスト結果

全体はPDF形式。各ステップはスクリーンショット、Stepトレース(Chromeの情報)、DOMスナップショット(HTML)、HTTP Archive(HAR)を取得できます。

PDF形式
// chrome_trace.json
{"traceEvents":[{"pid":336,"tid":336,"ts":3066165089,"ph":"(","cat":"blink","name":"FrameBlameContext","scope":"PlatformThread","id":"0x150","tts":38175,"args":{}},
{"pid":336,"tid":336,"ts":3066167089,"ph":"X","cat":"toplevel","name":"ThreadControllerImpl::RunTask","dur":41,"tdur":42,"tts":38244,"args":{"src_file":"../../ipc/ipc_mojo_bootstrap.cc","src_func":"Accept"}},
{"pid":336,"tid":336,"ts":3066167156,"ph":")","cat":"blink","name":"FrameBlameContext","scope":"PlatformThread","id":"0x150","tts":38312,"args":{}},
・・・
// step.har
{"log":{"version":"1.2","creator":{"name":"runner","version":"15b0302","comment":""},"pages":[{"id":"Page 0","startedDateTime":"2020-03-01T13:51:25.681Z","title":"Page 0","pageTimings":{"onLoad":32026,"comment":""},"comment":""}],"entries":[{"pageref":"Page 0",
・・・

Insightをダウンロード

// Broken Linkの場合
"page","link","status"
"https://help.mabl.com/docs/mabl-best-practices#section-9-integrate-mabl-with-your-delivery-pipeline","https://plugins.jenkins.io/mabl-integration","Newly Broken"
"https://help.mabl.com/docs/frequently-asked-questions#section-can-mabl-run-on-premise-in-a-single-tenant-environment","https://plugins.jenkins.io/mabl-integration","Newly Broken"
・・・
タイトルとURLをコピーしました