¹National Network New Media Engineering Research Center, Institute of Acoustics, Chinese Academy of Sciences, Beijing 100190, China
²University of Chinese Academy of Sciences, Beijing 100190, China

---

Abstract—Many network devices undertake tasks that involve extracting HTTP payload from a large number of data streams. In order to model such tasks and thus develop feasible approaches, this paper analyzes action characteristics of network byte stream reading and grammar of HTTP response message encoding. Based on this analysis, we propose a parsing algorithm for concurrent HTTP response streams, built upon stack buffer peeking operations and the extended finite state machine model. Implementation issues on parallel platforms are also studied in this paper. Our scheme is event-driven, does not require full buffering of the whole HTTP message, and saves one memory copy compared to naive static parsing method. Test results show that our method achieves better performance in terms of CPU and memory consumption.

Index Terms—HTTP response, chunked encoding, extended finite state machine

[PDF]

Cite: Mingzhe Li, Jinlin Wang, Xiao Chen, Jun Chen, "Event-Driven Extraction of HTTP Payload From Concurrent Streams," Journal of Software vol. 9, no. 10, pp. 2579-2585, 2014.