瀟å ããŒã«åãSLOïŒå®éã«å¹ãã·ã³ãã«ãªä¿¡é Œæ§ç®æš
瀟å ããŒã«åãSLOãã·ã³ãã«ã«ïŒèšæž¬å¯èœãªçšŒåçãšã¬ã€ãã³ã·ç®æšãèšå®ããå°ããªããŒã ãçãå°œããã«ç¶æã§ããã¢ã©ãŒãã«çµã³ã€ããŸãã

ãªã瀟å ããŒã«ã«ãSLOãå¿ èŠãïŒå©çšè ã20人ã§ãïŒ
瀟å ããŒã«ã¯å©çšè ãå°ãªãã®ã§å°ããæããŸããã圱é¿ã¯å°ãããªãããšãå€ãã§ãããªãã¹ããã·ã¥ããŒããèœã¡ãã°æ³šæåŠçãæ¢ãŸãããµããŒãã³ã³ãœãŒã«ãé ããã°é¡§å®¢ãåŸ ããããã管çç»é¢ãå£ããã°ä¿®æ£ãããŸããŸãã
æç¢ºãªä¿¡é Œæ§ç®æšããªããšãé害ããšã«è°è«ã«ãªããŸãããã人ã¯10åã®éå®³ãæ°ã«ããªãäžæ¹ãå¥ã®äººã¯å€§éšãããŸããææ§ãªåªå 床ãé©ãã®äœæ¥ã«æéã奪ãããŸãã
SLOã¯æž¬å®å¯èœãªã·ã³ãã«ãªæåŸ å€ãèšå®ããŠããã®åé¡ã解決ããŸããäœãåãã¹ããããããŠã©ã®çšåºŠåãã°ä»äºãã§ãããããšããå®çšçãªåãã«çããŸãã
ããŸããŸãå®å®ãããããšããæé»ã®ã³ã¹ãã¯ããçŸããŸããããŒã«ã®å埩ãåŸ ã£ãŠäœæ¥ãæ¢ãŸãããµããŒãã®åãåãããå¢ããããšã³ãžãã¢ãèšç»çãªæ¹åã§ã¯ãªãç·æ¥å¯Ÿå¿ã«åãããããããã¯ããªãŒããŒãã·ã¹ãã ãä¿¡é Œã§ããªããªãæåã®ä»£æ¿çãæ±ãããå°ããªåé¡ãæç¢ºãªåºæºãè¶ ããªããŸãŸæŸçœ®ããç¶ããŸãã
å®å šãªä¿¡é Œæ§ããã°ã©ã ã¯äžèŠã§ããå°ããªããŒã ãªãããã°ã€ã³ãåãããæ€çŽ¢ãéãè¿ãããªã©ãŠãŒã¶ãŒèŠç¹ã®ç®æšãããã€ã決ããå®éã®è¡åã«ã€ãªããå°æ°ã®ã¢ã©ãŒããèšå®ããã ãã§å§ããããŸãã
ããã¯ããŒã«ã®äœãæ¹ã«é¢ä¿ãªãåœãŠã¯ãŸããŸããããAppMaster (appmaster.io)ã§å éšã¢ããªãäœã£ãŠãããªãã人ãé Œãæäœãéžã³ã皌åçãšå¿çæéãæž¬ããæ¥åã«åœ±é¿ãåºããšãã ãã¢ã©ãŒãããããã«ããŠãã ããã
SLOãSLIãSLAãåããããã
䌌ãèšèã«èãããŸããããããã圹å²ãéããŸããæ··åã¯ãããã誀解ã®å ã§ãã
**SLIïŒService Level IndicatorïŒ**ã¯èšæž¬ããææšã§ããäŸãã°ãæåãããªã¯ãšã¹ãã®å²åãããããŒãžã®èªã¿èŸŒã¿ã«ããã£ãæéãã®ããã«æ°ãããããã®ã§ããä¿¡é ŒããŠèšæž¬ã§ããªããã®ã¯è¯ãSLIã§ã¯ãããŸããã
**SLOïŒService Level ObjectiveïŒ**ã¯ãã®ææšã«å¯Ÿããç®æšå€ã§ããæ®æ®µã®å©çšã§ãŠãŒã¶ãŒãå°ããªãã¬ãã«ã¯ã©ãããããã瀺ããŸããSLOã¯ãäœãåªå çã«çŽãã¹ãããäœãåŸåãã«ã§ãããã®å€æãå©ããŸãã
**SLAïŒService Level AgreementïŒ**ã¯æžé¢åãããçŽæã§ããã°ãã°äœããã®çµæïŒããã«ãã£ãªã©ïŒã䌎ããŸããå€ãã®ç€Ÿå ããŒã«ã¯SLAãå¿ èŠãšããŸãããå¿ èŠãªã®ã¯æç¢ºãªç®æšã§ãã£ãŠæ³ççŽæã§ã¯ãããŸããã
ç°¡åãªäŸ:
- SLIïŒçšŒåçïŒ: ããŒã«ãå°éå¯èœã ã£ãåã®å²åïŒååäœïŒ
- SLOïŒçšŒåçç®æšïŒ: æé99.9%ã®çšŒåç
- SLIïŒã¬ã€ãã³ã·ïŒ: ããã·ã¥ããŒãã®p95èªã¿èŸŒã¿æé
- SLOïŒã¬ã€ãã³ã·ç®æšïŒ: æ¥åæéäžã®p95ã2ç§æªæº
ããã§æ¬ ããŠããã®ã¯ã決ããŠèœã¡ãªãããåžžã«éãããšãã£ãå®ç§ãã®çŽæã§ããSLOã¯åŠ¥åç¹ãå¯èŠåããŠãå°ããªããŒã ãæ©èœè¿œå ãä¿¡é Œæ§æ¹åãç¡é§ãªæäœæ¥ã®åé¿ãéžã¹ãããã«ããŸãã
å®çšã«ãŒã«ïŒããç®æšãéæããã®ã«è±éçãªå¯Ÿå¿ãå¿ èŠãªããããã¯SLOã§ã¯ãªãåžæã«ãããŸããããŸãã¯ããŒã ãèœã¡çããŠç¶æã§ããç®æšããå§ãããŠãŒã¶ãŒã«ãŸã çã¿ãæ®ããªãåŸããå³ããããŠãã ããã
æ¬åœã«éèŠãªãŠãŒã¶ãŒæäœãçµã
瀟å ããŒã«ã®æ éã¯ç¹å®ã®åœ¢ã§èµ·ããããšãå€ãã§ãïŒç®¡çç»é¢ã¯è¡šç€ºããããä¿åã§æ°žé ã«åŸ ã€ããªãã¹ããã·ã¥ããŒãã¯éããã°ã©ããæŽæ°ãããªããã¹ã¿ããããŒã¿ã«ã¯åãããã°ã€ã³ãæŽæ°åŸã«å£ãããªã©ã䟡å€ãæå€§åãããã®ã¯ãæ¥åžžçã«äººãé Œãæäœã«çŠç¹ãåœãŠãããšã§ãã
ãŸãããŒã«ã®çš®é¡ãååã«ããããšãçš®é¡ãéèŠçµè·¯ã瀺ããŸãã管çç»é¢ã¯ãå®å šã«äœãã倿Žããããšãããã€ã³ãããªãã¹ããã·ã¥ããŒãã¯ãä»äœãèµ·ããŠãããã確èªããããšãããã€ã³ããããŒã¿ã«ã¯ãå ¥ã£ãŠæ å ±ãèŠã€ããç³è«ãããããšããã€ã³ãã§ãã
次ã«ãäž»èŠãªãŠãŒã¶ãŒãžã£ãŒããŒãåãããããæžãåºããŸããåºçºç¹ã«è¯ãäŸïŒ
- ãã°ã€ã³ããŠããŒã ç»é¢ã«å°éãã
- æ€çŽ¢ããã£ã«ã¿ããããŠçµæãåŸã
- ãã©ãŒã ãéä¿¡ïŒäœæïŒæŽæ°ïŒããŠæåã¡ãã»ãŒãžãåºã
- ã¡ã€ã³ã®ããã·ã¥ããŒããã¥ãŒãæ°ããããŒã¿ã§èªã¿èŸŒã
- æ¥æ¬¡äœæ¥ã§äœ¿ãã¬ããŒãããšã¯ã¹ããŒããŸãã¯ããŠã³ããŒããã
åãžã£ãŒããŒããšã«å€±æãšèŠãªãæ¡ä»¶ãå®çŸ©ããŸããå³å¯ãã€æž¬å®å¯èœã«ïŒ500ãšã©ãŒã¯å€±æãã¿ã€ã ã¢ãŠãã¯å€±æãããŒãžãèªã¿èŸŒã¿çµãããªãã®ã¯å€±æãæåãšè¿ã£ãŠãããŒã¿ãæ¬ ããŠããã®ã¯å€±æã§ãã
æåã¯ç¯å²ãå°ããä¿ã¡ãŸããå®éã®çã¿ãšãªã¹ã¯ã«åã1ã3ã®ãžã£ãŒããŒãéžã¶ããããªã³ã³ãŒã«ã§ããçºçããã®ãã誰ããã°ã€ã³ã§ããªãããšãä¿åãã¿ã³ãåºãŸãããªãããŸãã¯ãã°ã€ã³ãšãã©ãŒã éä¿¡ããå§ããæž¬å®ãšã¢ã©ãŒããä¿¡é Œã§ããããã«ãªã£ãŠããæ€çŽ¢ã远å ããŸãã
å®éã«èšæž¬ã§ããSLIãéžã¶
è¯ãSLIã¯å°å³ã§ããæ¢ã«æã£ãŠããããŒã¿ããåãããŠãŒã¶ãŒãããŒã«ã®æ£åžžåäœãé害ãæããç¹ã«äžèŽããŸããæ°ããç£èŠã»ããã¢ãããå¿ èŠã«ãªããªãããã£ãšåçŽãªSLIãéžãã§ãã ããã
ãŸãã¯å©çšè ãçè§£ããããå¯çšæ§ããå§ããŸãïŒããŒã«ãéããããã¿ã¹ã¯ãå®äºã§ããããå€ãã®ç€Ÿå ããŒã«ã§ã¯äºã€ã®SLIã§çã¿ã®å€§éšåãã«ããŒã§ããŸãã
- ããŒã«ã®çšŒåçïŒå°éå¯èœã§å¿çããããïŒ
- 1ã3ã®äž»èŠæäœã®æåçïŒãã°ã€ã³ãæ€çŽ¢ãä¿åãæ¿èªãªã©ïŒ
ãã®åŸã¬ã€ãã³ã·ã远å ããŸãããç¯å²ã¯çãããŸãããŠãŒã¶ãŒãé ããèŠããç»é¢ããšã³ããã€ã³ãã1ã2ã€éžã³ãŸãïŒäŸïŒããã·ã¥ããŒãã®èªã¿èŸŒã¿ããã©ãŒã éä¿¡ïŒãå šéšãèšæž¬ãããšãã€ãºãšè°è«ãå¢ããŸãã
èšæž¬ãŠã£ã³ããŠãæåã«æ±ºããŠãããŸããå®å®ããããŒã«ãªãããŒãªã³ã°30æ¥ãäžè¬çããªãªãŒã¹é »åºŠãé«ãæ©ããã£ãŒãããã¯ã欲ãããªãé±åäœã§ãè¯ããäœãéžãã§ãäžè²«ããŠäœ¿ãããšãéèŠã§ãã
æåŸã«ãSLIããšã«äžã€ã®çå®ã®æ å ±æºã決ããŠæžãæ®ããŸãã
- åæãã§ãã¯ïŒãããããã«ã¹ãã§ãã¯ãç°¡åãªãããŒãå®è¡ïŒ
- ãµãŒããŒã¡ããªã¯ã¹ïŒãªã¯ãšã¹ãæ°ããšã©ãŒãããã¯ãšã³ãã®ã¬ã€ãã³ã·ïŒ
- ãã°ïŒç¹å®æäœã®ãæåã察ã倱æããã«ãŠã³ãïŒ
äŸïŒå éšã¢ããªãAppMasterã§äœãããŠããå Žåãããã¯ãšã³ããžã®åæpingã§çšŒåçãæž¬ããAPIå¿çã§æåçããããã¯ãšã³ãã®åŠçæéã§ã¬ã€ãã³ã·ã枬ãããšãã§ããŸããéèŠãªã®ã¯å®ç§ãã§ã¯ãªãäžè²«æ§ã§ãã
çŸå®çãªçšŒåçãšã¬ã€ãã³ã·ã®SLOãèšå®ãã
ãŸãã¯æªãé±ã§ãæè·ã§ãã皌åçãéžã³ãŸããå€ãã®ç€Ÿå ããŒã«ã§99.5%ã¯è¯ãæåã®SLOã§ããé«ãèãããŸãããéåžžã®å€æŽäœæ¥ã®äœå°ãæ®ããŸãããããªã99.9%ã«ãããšæ·±å€ã®ããŒãžã³ã°ããªãªãŒã¹ã®é å»¶ã«ã€ãªãããã¡ã§ãã
皌åçã宿ãããããã«æéã«å€æããŸãããã30æ¥ïŒçŽ43200åïŒã§ã¯ïŒ
- 99.5%ã ãšæãããçŽ216åã®ããŠã³ã¿ã€ã ã蚱容
- 99.9%ã ãšæãããçŽ43åã®ããŠã³ã¿ã€ã ã蚱容
ãã®èš±å®¹ããŠã³ã¿ã€ã ããšã©ãŒããžã§ããã§ããæ©ãã«äœ¿ãåã£ãããªã¹ã¯ã®ãã倿Žãæ¢ããå埩ãããŸã§ä¿¡é Œæ§äœæ¥ã«éäžããŸãã
ã¬ã€ãã³ã·ã§ã¯å¹³åãé¿ããŠãã ãããå¹³åã¯ãŠãŒã¶ãŒãèŠããŠããé ãç¬éãé ããŸããããŒã»ã³ã¿ã€ã«ïŒéåžžp95ïŒã䜿ããå®éã®æäœã«çµã³ã€ãéŸå€ãèšå®ããŸããäŸïŒãp95ããã·ã¥ããŒãèªã¿èŸŒã¿ãæ¥åæéäž2ç§æªæºããp95ä¿åã800msæªæºããªã©ã
æåã®æ°å€ã決ããç°¡åãªæ¹æ³ã¯ãå®éã®ãã©ãã£ãã¯ã1é±é芳å¯ãã仿¥ããå°ãè¯ãå€ãç®æšã«ããããšã§ããp95ããã§ã«1.9ç§ã§ããã°2.0ç§ã®SLOã¯å®å šã§ãã500msã®SLOã¯éé³ãçãã ãã§ãã
SLOã¯ãµããŒãèœåã«åãããŠãã ãããå°ããªããŒã ãªã倿°ã®å³ããç®æšããéæå¯èœãªå°æ°ãéžã¶ã¹ãã§ãã誰ã1æé以å ã«å¯Ÿå¿ã§ããªããªãããã®åæã§ç®æšãèšå®ããªãã§ãã ããã
ãã¬ãŒããªããå¯èŠåããïŒã³ã¹ãããªã¹ã¯ããšã©ãŒããžã§ãã
å³ããSLOã¯å®å¿ãäžããŸããã³ã¹ãã䌎ããŸãã99.5%ãã99.9%ã«äžãããšã蚱容ã§ããæªãæéããå€§å¹ ã«æžããããŒãžã³ã°ãå¢ããæ©èœéçºããä¿¡é Œæ§äœæ¥ã«æéãå²ãããããšãå€ãã§ãã
ããã宿ãããæãç°¡åãªæ¹æ³ã¯ãšã©ãŒããžã§ããã§è©±ãããšã§ããæé99.5%ãªã30æ¥ã§çŽ3.6æéã®ããŠã³ã¿ã€ã ã䜿ããŸãã99.9%ã ãšçŽ43åãããããŸããããã®å·®ãæ©èœäœæ¥ãæ¢ããé »åºŠãå€ããŸãã
ãŸããæåŸ å€ã¯ããŒã«ãå®éã«äœ¿ãããæéã«åããããšè¯ãã§ãã24æéäœå¶ã®ç®æšã¯ãããŒã«ã9æã18æã«ããéèŠã§ãªãå Žåã³ã¹ããé«ããªããŸããæ¥åæéã¯å³ããã鿥åæéã¯ç·©ãããäºã€ã®SLOãèšããã°ããŒã ã¯ç ããŸãã
èšç»çãªã¡ã³ããã³ã¹ã¯ãäºåã«äŒãããç¯å²ãå®ããããŠããã°å€±æãšæ°ããªãã§æ§ããŸãããäºåŸã«ç¡èŠããã®ã§ã¯ãªãã¡ã³ããã³ã¹ãŠã£ã³ããŠãšããŠæç€ºããŠãã ããã
誰ãããã¬ãŒããªããèŠãããããã«åºæ¬ãææžåããŸãïŒ
- SLOã®æ°å€ãšããããå€ãããšãã«ãŠãŒã¶ãŒã倱ããã®
- æéã®ãšã©ãŒããžã§ããïŒåãæéã§ïŒ
- ããŒãžã³ã°ã«ãŒã«ïŒèª°ãããã€ãäœã«å¯ŸããŠïŒ
- æ¥åæéãš24/7ã®æåŸ å€ã®éã
- èšç»ã¡ã³ããã³ã¹ãäœã«åœããã
4ã6é±éã®å®ããŒã¿ã®åŸã«ç®æšãèŠçŽããŸãããšã©ãŒããžã§ãããã»ãšãã©æ¶è²»ããªããªãSLOã¯ç·©ãããŸããæ©æã«äœ¿ãåã£ãŠæ©èœãæ¢ãŸããªãå³ããããŸãã
ããŒã ãç¶æã§ããã¢ã©ãŒãã«SLOãçµã³ã€ãã
ã¢ã©ãŒãã¯SLOãã®ãã®ã§ã¯ãããŸãããã¢ã©ãŒãã¯SLOãå®ãããã®ãä»äœãããŸããããšããåå³ã§ããå®çšã«ãŒã«ïŒSLOããšã«æå³ã®ããã¢ã©ãŒãã1ã€äœãããã以äžã¯æ¬åœã«å¿ èŠãšèšŒæã§ããå Žåã ã远å ããŸãã
å®è·µçãªèãæ¹ã¯ããšã©ãŒããžã§ããã®æžãæ¹ãæ©ãããšãã¢ã©ãŒããããããŠãŒã¶ãŒãžã®çã¿ã«åèŽããäžã€ã®æç¢ºãªéŸå€ã§ã¢ã©ãŒãããããšã§ããäŸãã°ã¬ã€ãã³ã·SLOããp95 800msæªæºããªããåçºã®é å»¶ã§ããŒãžãé£ã°ããªãã§ãã ãããæç¶çãªåé¡ã«ãªã£ããšãã ãããŒãžã³ã°ããŸãã
ãã€ãºãæããããã®åçŽãªåãæ¹ïŒ
- ç·æ¥ããŒãžïŒããŒã«ãå®è³ªçã«äœ¿ããªããªã£ãŠããŠãããã«å¯Ÿå¿ãå¿ èŠ
- éç·æ¥ãã±ããïŒå£åã¯ãããæ¥åæéã«å¯Ÿå¿ã§ããçšåºŠ
å ·äœçéŸå€ïŒãã©ãã£ãã¯ã«åãããŠèª¿æŽïŒïŒçšŒåçSLOãæé99.5%ãªãã5åéã§å¯çšæ§ã99%æªæºãªãããŒãžã³ã°ïŒæç¢ºãªåæ¢ïŒã6æéã§99.4%æªæºãªããã±ããäœæïŒåŸã ã«æªåïŒãã¬ã€ãã³ã·ã¯p95ã15åé1.5sè¶ ãªãããŒãžã³ã°ã2æéã§1.0sè¶ ãªããã±ããããªã©ã
æææš©ãæç¢ºã«ããŸãã誰ããªã³ã³ãŒã«ãïŒããšããä»é±ã®1人ãã§ãïŒã確èªã®æå³ïŒäŸïŒ10å以å ã«å¿çïŒãšæåã®ã¢ã¯ã·ã§ã³ã決ããŸããå°èŠæš¡ããŒã ãAppMasterã§å éšã¢ããªãéçšããŠãããªããæåã®è¡åã¯æè¿ã®ãããã€ã確èªãããAPIãšã©ãŒãèŠããå¿ èŠãªãããŒã«ããã¯ãåãããã€ããããªã©ãçŸå®çã§ãã
å®éã«ã¢ã©ãŒãããã£ããå¿ ãå°ããªãã©ããŒã¢ãããäžã€è¡ã£ãŠãã ããïŒåå ãçŽãããã¢ã©ãŒãã調æŽããŠæ¬åœã«åœ±é¿ã®ãããšãã ã鳎ãããã«ããŸãã
ã¢ã©ãŒãç²ããçãããããééã
ã¢ã©ãŒãç²ãã¯è¯ãæå³ããå§ãŸãããšãå€ãã§ããå°ããªããŒã ããã¡ãã£ãšã ããã¢ã©ãŒããå¢ãããŠãããæ°ãã€ããšéç¥ãä¿¡é Œããªããªãæ¬åœã®é害ãèŠéããŸãã
倧ããªèœãšã穎ã¯ããã¹ãŠã®ã¹ãã€ã¯ã«ã¢ã©ãŒããåºãããšã§ãã瀟å ããŒã«ã¯ããŒã¹ãã£ãªãã©ãã£ãã¯ïŒçµŠäžåŠçãææ«ã®ã¬ããŒãïŒãããã2åã®çãããªããã§ã¢ã©ãŒãã鳎ããšäººã¯ç¡èŠããããã«ãªããŸããã¢ã©ãŒãã¯ãŠãŒã¶ãŒåœ±é¿ã«çµã³ã€ããŠãã ãããçã®ã¡ããªã¯ã¹ã®ãã€ãºã§ã¯ãããŸããã
ãŸããã¡ããªã¯ã¹ãå€ãã»ã©å®å šã ããšããèããå±éºã§ããããŠãã¯ããŒãžã³ã°å¢ã«ã€ãªãããŸãããŠãŒã¶ãŒãå®éã«æããå°æ°ã®ä¿¡å·ã«çµã£ãŠãã ããïŒãã°ã€ã³å€±æãããŒãžãé ããäž»èŠãžã§ããçµãããªãããªã©ã
æããã€ãºãçããã¹ïŒ
- CPUãã¡ã¢ãªãªã©ã®çç¶ã§ããŒãžã³ã°ãããŠãŒã¶ãŒåœ±é¿ã«ã¯çŽçµããªã
- ã¢ã©ãŒãã«ææè ãããªããããã¥ãŒãã³ã°ãåé€ããããªã
- ã©ã³ããã¯ããªããæ¯åææ¢ãã«ãªã
- ããã·ã¥ããŒããã¢ã©ãŒãã®ä»£ããã«äœ¿ãïŒããã·ã¥ããŒãã¯èšºæçšãã¢ã©ãŒãã¯è¡åçšïŒ
- ã·ã¹ãã ã®èšæž¬ãååã§ãªãã®ã«éŸå€ãã§ã£ã¡äžãã
ããã·ã¥ããŒãã¯å€§äºã§ãããã¢ã©ãŒãã眮ãæãããã®ã§ã¯ãããŸãããã¢ã©ãŒãçºçåŸã®èšºæã«äœ¿ãã¹ãã§ãã
ãŸã èšæž¬ãæŽã£ãŠããªããªãåœè£ ããªãã§ãã ããããŸãåºæ¬çãªèšè£ ïŒæåçãp95ã¬ã€ãã³ã·ãããŠãŒã¶ãŒãã¿ã¹ã¯ãå®äºã§ããããã®ãã§ãã¯ïŒã远å ãã1ã2é±éã®å®ããŒã¿ã«åºã¥ããŠéŸå€ãèšå®ããŸãã
ã¢ã©ãŒãããªã³ã«ããåã®ç°¡åãªãã§ãã¯ãªã¹ã
ã¢ã©ãŒãç²ãã®å€ãã¯ããããã®åºæ¬ãã¹ãããããŠåŸã§æ ãŠãããšããæ¥ãŸããå°ããªããŒã åãã®å®çšãã§ãã¯ãªã¹ãïŒ
- 1ã3ã®äž»èŠãŠãŒã¶ãŒæäœã確èªïŒäŸïŒããã·ã¥ããŒããéãããã±ããæŽæ°ãä¿åãã¬ããŒãããšã¯ã¹ããŒãïŒ
- 仿¥èšæž¬ã§ãã2ã4ã®SLIã«çµãïŒå¯çšæ§ïŒæåçãp95ã¬ã€ãã³ã·ãéèŠãšã³ããã€ã³ãã®ãšã©ãŒçïŒ
- ããŒã«ããšã®ã¢ã©ãŒãã¯åèš2ã4ä»¶ã«å¶éãã
- èšæž¬ãŠã£ã³ããŠãšãæªããã®å®çŸ©ã«åæããïŒé«éæ€åºãªãçŽè¿5åããã€ãºãæžãããªãçŽè¿30ã60åïŒ
- æ åœè ãæ±ºããïŒããŒã ã§ã¯ãªãå人ïŒ
次ã«ãã¢ã©ãŒããå®éã«å¯Ÿå¿ã§ãããã®ã§ããããšã確èªããŸãã誰ã察å¿ã§ããªãæéã«é³Žãã¢ã©ãŒãã¯ç¡èŠãããããã«ãªããŸãã
æåã®ããŒãžãé£ã¶åã«éçšã®è©³çŽ°ãæ±ºããŸãïŒ
- ããŒãžã³ã°æéåž¯ïŒæ¥åæéã®ã¿ã24/7ã
- ãšã¹ã«ã¬ãŒã·ã§ã³çµè·¯ïŒæåã®äººãå¿çããªããšãèª°ãæ¬¡ã
- æåã«ããããšïŒåœ±é¿ç¢ºèªãšããŒã«ããã¯ãç·©åã®ããã®1ã2ã¹ããã
- ææ¬¡ã®ç°¡åãªã¬ãã¥ãŒç¿æ £ïŒé³Žã£ãã¢ã©ãŒããèŠéããã€ã³ã·ãã³ããSLOã®åŠ¥åœæ§ã15åã§ç¢ºèª
ããŒã«ãäœã£ãã倿ŽãããïŒAppMasterã§ã®åçæãå«ãïŒãã§ãã¯ãªã¹ããåå®è¡ããŠãã ãããåçæãããã³ãŒããæ°ãããããŒã¯ã¬ã€ãã³ã·ããšã©ãŒã®ãã¿ãŒã³ãå€ããã¢ã©ãŒããããã«åãããå¿ èŠããããŸãã
äŸïŒå°ããªãªãã¹ããã·ã¥ããŒãïŒSLO2ã€ãã¢ã©ãŒã3ã€ïŒ
ãã18人ã®ãªãããŒã ãæ³šæç¶æ³ç¢ºèªã倱æéç¥åéãè¿éæ¿èªãæ¥åžžçã«è¡ãå éšããã·ã¥ããŒãã䜿ã£ãŠããŸããèœã¡ããé ããšäœæ¥ãããæ¢ãŸããŸãã
圌ãã¯äºã€ã®SLOãéžã³ãŸããïŒ
- 皌åçSLOïŒ 30æ¥ã§99.9%ã®æåããããŒãžèªã¿èŸŒã¿ïŒæçŽ43åã®ãæªãæéãïŒ
- ã¬ã€ãã³ã·SLOïŒ æ¥åæéäžã®p95ããŒãžèªã¿èŸŒã¿ã1.5ç§æªæº
次ã«å°ããªããŒã ã§å¯Ÿå¿ã§ãã3ã€ã®ã¢ã©ãŒãã远å ããŸããïŒ
- ããŒãããŠã³ã¢ã©ãŒãïŒããŒãžèªã¿èŸŒã¿å€±æïŒïŒ æåçã5åéã§98%æªæºã«ãªã£ããšãã«çºçãæåã®ã¢ã¯ã·ã§ã³ïŒæè¿ã®ãããã€ã確èªããŠã§ãã¢ããªãåèµ·åãããŒã¿ããŒã¹ã®å¥å šæ§ã確èªã
- é ãããã·ã¥ããŒãã¢ã©ãŒãïŒ p95ã¬ã€ãã³ã·ã10åéã§2.5ç§è¶ ã«ãªã£ããšãã«çºçãæåã®ã¢ã¯ã·ã§ã³ïŒåäžã®é ãã¯ãšãªãè©°ãŸã£ãããããžã§ããæ¢ããéãã¬ããŒããäžæåæ¢ããã
- ãšã©ãŒããžã§ããççŒã¢ã©ãŒãïŒ ä»åŸ7æ¥ã§æéãšã©ãŒããžã§ããã®50%ã䜿ããããªãšãã«çºçãæåã®ã¢ã¯ã·ã§ã³ïŒå¿ é ã§ãªã倿Žãæ¢ããã
次é±ã«äœãèµ·ããããéèŠã§ãããããšã©ãŒããžã§ããã¢ã©ãŒãã2å鳎ã£ãããããŒã ã¯æç¢ºã«å€æããŸãïŒæ°æ©èœãé ãããæã倧ããªã¬ã€ãã³ã·åå ã2æ¥ã§çŽãïŒäŸïŒã€ã³ããã¯ã¹ã®ãªãããŒãã«ã¹ãã£ã³ïŒãAppMasterã§ããŒã«ãäœã£ãŠãããªããããŒã¿ã¢ãã«ã調æŽããŠåçæã»åãããã€ããå¿æ¥åŠçœ®ãç©ã¿éãã代ããã«ã¯ãªãŒã³ãªã³ãŒãã§çŽããŸãã
SLOããããžã§ã¯ãåããã«ç¶æããæ¹æ³
SLOã¯å®éã®ä»äºãšã€ãªãã£ãŠããéã圹ã«ç«ã¡ãŸããã³ãã¯SLOãæ°ãã倧ããªããã°ã©ã ã«ããã®ã§ã¯ãªããå°ããªç¿æ £ã«ããããšã§ãã
å°ããªããŒã ã«åãéçšé »åºŠã決ããæ¢åã®äŒè°ã«çµã¿èŸŒã¿ãŸãã鱿¬¡ã®çããã§ãã¯ã§å€åãæãŸããææ¬¡ã®åŸ®èª¿æŽã§è¶³ããããšãå€ãã§ãã
èããã軜éãªããã»ã¹äŸïŒ
- 鱿¬¡ïŒ10åïŒïŒSLOãã£ãŒããšçŽè¿ã®ã¢ã©ãŒãã確èªããæªåãéãã«é²ãã§ããªãã確èª
- ã€ã³ã·ãã³ãåŸïŒ15åïŒïŒåå ã«ã¿ã°ãä»ããã©ã®ãŠãŒã¶ãŒæäœã圱é¿ãåãããèšé²ïŒãã°ã€ã³ãæ€çŽ¢ãä¿åããšã¯ã¹ããŒããªã©ïŒ
- ææ¬¡ïŒ30åïŒïŒç¹°ãè¿ãã€ã³ã·ãã³ããã¿ãŒã³ã®äžäœãã¬ãã¥ãŒããæ¥æã®1ã€ã®ä¿®æ£ãéžã¶
- ææ¬¡ïŒ10åïŒïŒãã€ãºã®å€ãã¢ã©ãŒãã1ã€åé€ãŸãã¯èª¿æŽãã
æ¹åã¯å°ããç®ã«èŠãããã®ã«ããŸãããããæ¯é±æææã«é ããªããã3åç¶ããªãã1ã€å ·äœçãªå€æŽïŒã¬ããŒãã®ãã£ãã·ã¥ãã€ã³ããã¯ã¹è¿œå ãéããžã§ãã®ã¹ã±ãžã¥ãŒã«å€æŽïŒãè¡ããç¿é±ã®SLIã芳å¯ããŸãã
SLOã¯äžå¯§ã«ãæãçç±ããšããŠã䜿ããŸãã䟡å€ã®äœãæ©èœèŠæ±ãæ¥ãããçŸåšã®ãšã©ãŒããžã§ããã瀺ããŠããã®å€æŽãä¿åãæ¿èªãããŒãå±éºã«æããïŒããšåããŸããããæ¢ã«ããžã§ãããæ¶è²»äžãªãä¿¡é Œæ§ãåªå ããŸããããã¯ãããã¯ã§ã¯ãªãåªå é äœä»ãã§ãã
ããã¥ã¡ã³ãã¯æå°éã«ïŒããŒã«ããšã«1ããŒãžãäž»èŠãŠãŒã¶ãŒæäœãSLOæ°å€ãããã«çŽã¥ãå°æ°ã®ã¢ã©ãŒããææè ãèšèŒãAppMasterã§äœããªããã°ïŒã¡ããªã¯ã¹ãèŠãå Žæãšèª°ããããã€ã§ããããæžããŠãããããã§çµããã«ããŸãã
次ã®ã¹ãããïŒå°ããå§ããããŒã«ãäžã€ãã€æ¹åãã
ä¿¡é Œæ§ãçŸå®ã«ããæãç°¡åãªæ¹æ³ã¯ãæåã®ã»ããã¢ãããæ¥µå°ã«ä¿ã€ããšã§ããå£ãããšãã«å®éã«çã¿ãçã1ã€ã®ç€Ÿå ããŒã«ãéžã³ãæ¥ã ã®æ°ã¢ã¯ã·ã§ã³ã«çŠç¹ãåœãŠãŸãã
å€ãã®ããŒã ãã³ããŒã§ããæå°éã®ã»ããã¢ããäŸïŒ
- 1ã€ã®ããŒã«ãš2ã€ã®äž»èŠãŠãŒã¶ãŒæäœãéžã¶ïŒäŸïŒããã·ã¥ããŒããéããæ¿èªãéä¿¡ïŒ
- ä»ããèšæž¬ã§ãã2ã€ã®SLIãå®çŸ©ïŒãšã³ããã€ã³ãïŒããŒãžã®çšŒåçãšæäœã®p95ã¬ã€ãã³ã·
- 2ã€ã®ã·ã³ãã«ãªSLOãèšå®ïŒäŸïŒæé99.5%ã®çšŒåçãæ¥åæéäžã®p95 800msæªæºïŒ
- åèš2ã3ã®ã¢ã©ãŒããäœãïŒããŒãããŠã³ãæç¶çãªã¬ã€ãã³ã·ããšã©ãŒããžã§ããã®æ¥éæ¶è²»
- é±ã«1å10åã§ã¬ãã¥ãŒïŒã¢ã©ãŒãã¯åœ¹ã«ç«ã£ããããããšããã€ãºãïŒ
å®å®ããããã£ããåºããŸãïŒ1ã€ã®æäœãå¢ããããæã«1ã€ã®ããŒã«ã远å ãããã¢ã©ãŒãã®ææè ãæ±ºããããªããªãããã®ã¢ã©ãŒãã¯ãŸã äœããªãã§ãã ããã
å éšããŒã«ãäœã£ããäœãçŽãå ŽåãAppMasterã¯ä¿å®ãæç¶ããããããŸããããŒã¿ã¢ãã«ãããžãã¹ããžãã¯ãèŠèŠçã«æŽæ°ããŠã¯ãªãŒã³ãªã³ãŒããåçæã§ãããããSLOãå®éã®æåã«åãããŠä¿ã¡ããããªããŸãã
忥ãã1ã€ã®ç€Ÿå ããŒã«ãäœããåºæ¬çãªSLOãçµã¿èŸŒãã§ã¿ãŠãã ãããæåŸ ãæç¢ºã«ãªããé©ããæžããå°ããªããŒã ã§ãç¶æã§ããã¢ã©ãŒããå®çŸããŸãã
ãããã質å
SLOã¯ãã ãããå®å®ããŠããããæž¬å®å¯èœãªç®æšã«å€ããŠãä¿¡é Œæ§ã«é¢ããè°è«ãæ¢ããŸãããŠãŒã¶ãŒã20人çšåºŠã§ããåæ¢ãæ³šæåŠçãæ¢ããããµããŒããé ããããæ¿èªãåæ»ããããªãã圱é¿ã¯å€§ãããªãåŸãŸãã
äººãæ¯æ¥è¡ãæäœã§ã倱æãããšäœæ¥ãæ¢ãŸããã®ãããã€ãéžã³ãŸããããããåºçºç¹ã¯ãã°ã€ã³ãã¡ã€ã³ããã·ã¥ããŒãã®èªã¿èŸŒã¿ïŒææ°ããŒã¿ïŒãæ€çŽ¢ïŒãã£ã«ã¿ãäœæïŒæŽæ°ãã©ãŒã ã®éä¿¡ã§ãã
SLIã¯èšæž¬ããææšïŒæåçãp95ã¬ã€ãã³ã·ãªã©ïŒãSLOã¯ãã®ææšã«å¯Ÿããç®æšïŒäŸïŒ30æ¥ã§99.5%ïŒãSLAã¯é垞眰åãäŒŽãæ£åŒãªçŽæã§ãã»ãšãã©ã®ç€Ÿå ããŒã«ã«ã¯äžèŠã§ãã
å€ãã®ç€Ÿå ããŒã«ã«ãšã£ãŠãŸãçŸå®çãªçšŒåçSLOã¯ææ¬¡99.5%ã§ããããã¯éåžžã®å€æŽäœæ¥ã®äœå°ãæ®ãã€ã€ãåžžæã®ããŒããŒå¯Ÿå¿ãèŠæ±ããŸãããæ¥åæéã®ã¿ã§éèŠãªãåŸããå³ããã§ããŸãã
皌åçãåãããããããã«ã¯æéã«æç®ããŸãã30æ¥ã§ã¯99.5%ãçŽ216åã99.9%ãçŽ43åã§ãããã®å·®ãã©ãã ãé »ç¹ã«æ©èœåæ¢ã§äœæ¥ãæ¢ããããå·Šå³ããŸãã
å¹³åå€ã§ã¯ãªãããŒã»ã³ã¿ã€ã«ïŒéåžžp95ïŒã䜿ã£ãŠãã ãããäŸïŒãp95ã§ããã·ã¥ããŒãèªã¿èŸŒã¿ãæ¥åæéäž2ç§ä»¥äžããå®éã®ãã©ãã£ãã¯ã1é±é芳å¯ããçŸåšããå°ãè¯ãå€ãç®æšã«ãããšçŸå®çã§ãã
æ¢ã«æã£ãŠãããµãŒãææšããã°ããå§ããŸãïŒå°éå¯èœæ§ïŒå¿çãããïŒãäž»èŠæäœã®æåçã1ã2ç®æã®p95ã¬ã€ãã³ã·ãéèŠãªãããŒã«ã¯åæãã§ãã¯ãè¶³ãçšåºŠã§ãèšæž¬ã¯äžè²«æ§ãåªå ããŠãã ããã
ãŠãŒã¶ãŒåœ±é¿ã«çµã³ä»ãå°æ°ã®ã¢ã©ãŒãã«çµããæç¶çãªåé¡ã§ã®ã¿ããŒãžã³ã°ããã®ãè¯ãã§ããéåžžã¯ãé倧ãªåæ¢ã®ããŒãžããšãéç·æ¥ã®ãã±ããïŒåŸã ã«æªåïŒãã®äºåæ³ãæå¹ã§ãã
ã¹ãã€ã¯ããšã«ããŒãžã³ã°ããããCPUãªã©ã®ææšã ãã§èŠå ±ãåºããšç²åŒããŸããã¢ã©ãŒãã¯å°æ°ã«çµããåã¢ã©ãŒãã«æ åœè ãã€ããçºçåŸã¯åå ãçŽããã¢ã©ãŒãã調æŽããŠããéçšãç¶ããŠãã ããã
ã¢ããªå ã®äž»èŠãªæäœãéžã³ã皌åçãæåçãp95ã¬ã€ãã³ã·ãäžè²«ããåºæºã§èšæž¬ããŸããAppMasterã§äœãå Žåã§ãããã°ã€ã³ã»ä¿åã»æ€çŽ¢ãªã©ãŠãŒã¶ãŒãå®éã«äœ¿ãåäœãåºç¹ã«ããåçæã倧ããªå€æŽåŸã¯èšæž¬ãšã¢ã©ãŒããèŠçŽããŠãã ããã


