In the previous article, I described the problems that we encountered at the very beginning of the formation of QA processes in our repository, as well as the first steps to fix them. In this article I will tell you how we dealt with the remaining problems, what tools we used and what our plans are.
So let's go!
, :
.
.
.
.
.
, , flow.
(vial, live test)
vial live — ETL-. , test- , vial. , vial , - test.
: .
: , .
:
;
test - .
test?
-, test . , . , , , - , , ETL- . .
-, vial . , ( ) vial prod. test.
, test’ .
test flow ?
, :
;
;
.
, .
QA- / - . ( ).
, - - . test- , . .
, .
, . . .
, .
, , , , .
— -, , QA-, , , .
?
.
.
.
.
.
.
. , , . , .
— , .
, — , vial- - .
20:30, . , Jira «». , . .
QA ( , , ) .
vial , . slack-.
, ! .
, :
;
.
, . . .
, ETL- , ETL- , .
.
Meta-review
SAS Data Integration Studio. SAS- — . , SAS- , .
, , , . , GP, . .
Package-review
— VCS -, , , , .
Package-review -. , , , , , , . package-review -, , .
Diff-review
python-, diff-.
Log-review
.
, . python + pytest , :
.
, .
Allure.
: . , ETL- , . : .
?
Static — , ETL-.
BI — SAP BO .
— ETL- .
Work — / , .
.
, :
.
.
.
. ?
MG ( ), , .
vial, .
, ( DB- ), — - .
:
.
80—90%.
.
, , BI , .
, python, SQL-, .
?
ddl(‘_’) — DDL- , .
profile(‘_’) — ( , . .).
dq_check(‘_’, ‘’) — , NULL , .
compare_(‘1’, ‘2’, ‘’) — , .
Compare() , , .
, (12 987 767 234 ) , order_id 9 458 234 .
ETL- — , — .
compare() . : , ( ).
- Allure
Allure - , , , , . , vial, -.
, . , . : , . .
python, QA- , .
. , — .
QA-, . . , .
flow.
:
— vial .
— . , .
— vial/live, live — .
— .
( , ) — , .
, , , — .
, — QA.
, .
?
QA.
QA — QA SRE.
.
.
vial, . , .
, , SQL- ( ), ETL-, .
, . QA .
, , .
: . .
DWH , .
:
, : , / , , . .
: , , . .
, .
, .
, QA , . , . .
, !