nGrinder를 사용한 서버 부하테스트 #788

jminkkk · 2024-10-15T05:01:49Z

jminkkk
Oct 15, 2024
Maintainer

TPS 측정

zeus6768 · 2024-10-15T05:16:39Z

zeus6768
Oct 15, 2024
Maintainer

우리의 첫 도전 vuser=100

3 replies

zeus6768 Oct 15, 2024
Maintainer

vuser를 3000으로 할 때 broken pipe

+) AsyncRequestNotUsableException

zeus6768 Oct 15, 2024
Maintainer

사용자 수 3000, 1분 동안 templates 요청 시 발생한 오류

[ERROR][10-15 14:22:00][cab761e0][c.g.e.GlobalExceptionHandler:53] [Exception] 예상치 못한 오류 org.springframework.web.context.request.async.AsyncRequestNotUsableException 가 발생했습니다.
org.springframework.web.context.request.async.AsyncRequestNotUsableException: ServletOutputStream failed to write: java.io.IOException: Broken pipe
	at org.springframework.web.context.request.async.StandardServletAsyncWebRequest$LifecycleHttpServletResponse.handleIOException(StandardServletAsyncWebRequest.java:320)
	at org.springframework.web.context.request.async.StandardServletAsyncWebRequest$LifecycleServletOutputStream.write(StandardServletAsyncWebRequest.java:378)
	at java.base/java.io.OutputStream.write(OutputStream.java:127)
	at org.springframework.util.StreamUtils.copy(StreamUtils.java:117)
	at org.springframework.http.converter.ByteArrayHttpMessageConverter.writeInternal(ByteArrayHttpMessageConverter.java:67)
	at org.springframework.http.converter.ByteArrayHttpMessageConverter.writeInternal(ByteArrayHttpMessageConverter.java:38)
	at org.springframework.http.converter.AbstractHttpMessageConverter.write(AbstractHttpMessageConverter.java:235)
	at org.springframework.web.servlet.mvc.method.annotation.AbstractMessageConverterMethodProcessor.writeWithMessageConverters(AbstractMessageConverterMethodProcessor.java:300)
	at org.springframework.web.servlet.mvc.method.annotation.RequestResponseBodyMethodProcessor.handleReturnValue(RequestResponseBodyMethodProcessor.java:192)
	at org.springframework.web.method.support.HandlerMethodReturnValueHandlerComposite.handleReturnValue(HandlerMethodReturnValueHandlerComposite.java:78)
	at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:136)
	at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:926)
	at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:831)
	at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87)
	at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1089)
	at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:979)
	at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1014)
	at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:903)
	at jakarta.servlet.http.HttpServlet.service(HttpServlet.java:564)
	at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:885)
	at jakarta.servlet.http.HttpServlet.service(HttpServlet.java:658)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:195)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:140)
	at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:51)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:164)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:140)
	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:101)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:164)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:140)
	at codezap.global.logger.MDCFilter.doFilter(MDCFilter.java:29)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:164)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:140)
	at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100)
	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:116)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:164)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:140)
	at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93)
	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:116)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:164)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:140)
	at org.springframework.web.filter.ServerHttpObservationFilter.doFilterInternal(ServerHttpObservationFilter.java:107)
	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:116)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:164)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:140)
	at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201)
	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:116)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:164)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:140)
	at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:167)
	at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:90)
	at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:482)
	at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:115)
	at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:93)
	at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74)
	at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:344)
	at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:389)
	at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:63)
	at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:904)
	at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1741)
	at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:52)
	at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1190)
	at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659)
	at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:63)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.catalina.connector.ClientAbortException: java.io.IOException: Broken pipe
	at org.apache.catalina.connector.OutputBuffer.realWriteBytes(OutputBuffer.java:341)
	at org.apache.catalina.connector.OutputBuffer.appendByteArray(OutputBuffer.java:746)
	at org.apache.catalina.connector.OutputBuffer.append(OutputBuffer.java:667)
	at org.apache.catalina.connector.OutputBuffer.writeBytes(OutputBuffer.java:376)
	at org.apache.catalina.connector.OutputBuffer.write(OutputBuffer.java:354)
	at org.apache.catalina.connector.CoyoteOutputStream.write(CoyoteOutputStream.java:103)
	at org.springframework.web.context.request.async.StandardServletAsyncWebRequest$LifecycleServletOutputStream.write(StandardServletAsyncWebRequest.java:375)
	... 62 common frames omitted
Caused by: java.io.IOException: Broken pipe
	at java.base/sun.nio.ch.FileDispatcherImpl.write0(Native Method)
	at java.base/sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:62)
	at java.base/sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:132)
	at java.base/sun.nio.ch.IOUtil.write(IOUtil.java:97)
	at java.base/sun.nio.ch.IOUtil.write(IOUtil.java:53)
	at java.base/sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:532)
	at org.apache.tomcat.util.net.NioChannel.write(NioChannel.java:122)
	at org.apache.tomcat.util.net.NioEndpoint$NioSocketWrapper.doWrite(NioEndpoint.java:1378)
	at org.apache.tomcat.util.net.SocketWrapperBase.doWrite(SocketWrapperBase.java:764)
	at org.apache.tomcat.util.net.SocketWrapperBase.writeBlocking(SocketWrapperBase.java:589)
	at org.apache.tomcat.util.net.SocketWrapperBase.write(SocketWrapperBase.java:533)
	at org.apache.coyote.http11.Http11OutputBuffer$SocketOutputBuffer.doWrite(Http11OutputBuffer.java:533)
	at org.apache.coyote.http11.filters.IdentityOutputFilter.doWrite(IdentityOutputFilter.java:73)
	at org.apache.coyote.http11.Http11OutputBuffer.doWrite(Http11OutputBuffer.java:193)
	at org.apache.coyote.Response.doWrite(Response.java:623)
	at org.apache.catalina.connector.OutputBuffer.realWriteBytes(OutputBuffer.java:329)
	... 68 common frames omitted

zeus6768 Oct 15, 2024
Maintainer

100 번 보냈을 때

CPU

prod -a

prod -b

TPS

prod -a

prod -b

zeus6768 · 2024-10-15T05:33:53Z

zeus6768
Oct 15, 2024
Maintainer

우리의 두 번째 도전 vuser=200

0 replies

zeus6768 · 2024-10-15T05:37:33Z

zeus6768
Oct 15, 2024
Maintainer

우리의 도전 vuser=300

0 replies

jminkkk · 2024-10-15T05:53:07Z

jminkkk
Oct 15, 2024
Maintainer Author

요청 처리 시간 폭등함 ㅠ
0.3 초대에서

0 replies

zeus6768 · 2024-10-15T06:04:33Z

zeus6768
Oct 15, 2024
Maintainer

우리의 도전 vuser=300 두번째

TPS 확떨어짐

0 replies

zeus6768 · 2024-10-16T05:20:03Z

zeus6768
Oct 16, 2024
Maintainer

vuser=400 에서 실패

2 replies

zangsu Oct 16, 2024
Maintainer

응답: 499 발생
스프링 로그 :

커넥션 설정 고려 사항

데드락 피하기
커넥션 풀 사이즈를 지정할 때는 항상 데드락을 고려해야 한다.
우아한 형제들에서 제시한 이론적으로 필요한 최소한의 커넥션 풀 사이즈는 다음과 같다.

PoolSize = Tn × ( Cm -1 ) + 1

Tn : 전체 Thread 갯수
Cm : 하나의 Task에서 동시에 필요한 Connection 수
→ 이 경우는 데드락은 피할 수 있지만, 여유 커넥션이 +1 개 이므로 성능상 좋지 못할 수 있다.

커넥션 풀에 더욱 여유를 주고 싶다면 아래와 같이 해보자.

PoolSize = Tn × ( Cm - 1 ) + ( Tn / 2 )

thread count : 16
simultaneous connection count : 2
pool size : 16 * ( 2 – 1 ) + (16 / 2) = 24

zangsu Oct 16, 2024
Maintainer

# application.yml
spring:
  datasource:
    url: jdbc:mysql://localhost:3306/example
    username: 
    password: 
    driver-class-name: com.mysql.jdbc.Driver
    hikari:
      connection-timeout: 30000  # 커넥션 타임아웃 설정 (ms)
      maximum-pool-size: 10  # 커넥션 풀의 최대 크기 설정
      minimum-idle: 5  # 유휴 커넥션을 유지할 최소한의 커넥션 수 설정
      idle-timeout: 600000  # 유휴 커넥션의 최대 유지 시간 설정 (ms)
      pool-name: MyHikariCP  # 커넥션 풀의 이름 설정
      validation-timeout: 5000  # 커넥션 유효성 검사 타임아웃 설정 (ms)
      auto-commit: true  # 자동 커밋 모드 설정

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

nGrinder를 사용한 서버 부하테스트 #788

{{title}}

Replies: 6 comments 5 replies

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

Select a reply

nGrinder를 사용한 서버 부하테스트 #788

jminkkk Oct 15, 2024 Maintainer

Replies: 6 comments · 5 replies

zeus6768 Oct 15, 2024 Maintainer

우리의 첫 도전 vuser=100

zeus6768 Oct 15, 2024 Maintainer

zeus6768 Oct 15, 2024 Maintainer

zeus6768 Oct 15, 2024 Maintainer

100 번 보냈을 때

CPU

TPS

zeus6768 Oct 15, 2024 Maintainer

우리의 두 번째 도전 vuser=200

zeus6768 Oct 15, 2024 Maintainer

우리의 도전 vuser=300

jminkkk Oct 15, 2024 Maintainer Author

zeus6768 Oct 15, 2024 Maintainer

우리의 도전 vuser=300 두번째

TPS 확떨어짐

zeus6768 Oct 16, 2024 Maintainer

vuser=400 에서 실패

zangsu Oct 16, 2024 Maintainer

zangsu Oct 16, 2024 Maintainer

jminkkk
Oct 15, 2024
Maintainer

Replies: 6 comments 5 replies

zeus6768
Oct 15, 2024
Maintainer

zeus6768 Oct 15, 2024
Maintainer

zeus6768 Oct 15, 2024
Maintainer

zeus6768 Oct 15, 2024
Maintainer

zeus6768
Oct 15, 2024
Maintainer

zeus6768
Oct 15, 2024
Maintainer

jminkkk
Oct 15, 2024
Maintainer Author

zeus6768
Oct 15, 2024
Maintainer

zeus6768
Oct 16, 2024
Maintainer

zangsu Oct 16, 2024
Maintainer

zangsu Oct 16, 2024
Maintainer