From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-3.8 required=3.0 tests=BAYES_00, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS, URIBL_BLOCKED autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id A1982C47094 for ; Thu, 10 Jun 2021 16:04:25 +0000 (UTC) Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id EE8846128A for ; Thu, 10 Jun 2021 16:04:24 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org EE8846128A Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=bugs.launchpad.net Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Received: from localhost ([::1]:42332 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1lrNAO-0001S0-5b for qemu-devel@archiver.kernel.org; Thu, 10 Jun 2021 12:04:24 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:34854) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lrN74-00028v-B5 for qemu-devel@nongnu.org; Thu, 10 Jun 2021 12:01:01 -0400 Received: from indium.canonical.com ([91.189.90.7]:52742) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1lrN6y-0005B6-F3 for qemu-devel@nongnu.org; Thu, 10 Jun 2021 12:00:57 -0400 Received: from loganberry.canonical.com ([91.189.90.37]) by indium.canonical.com with esmtp (Exim 4.93 #5 (Debian)) id 1lrN6u-0002Di-RN for ; Thu, 10 Jun 2021 16:00:48 +0000 Received: from loganberry.canonical.com (localhost [127.0.0.1]) by loganberry.canonical.com (Postfix) with ESMTP id BFDCF2E8169 for ; Thu, 10 Jun 2021 16:00:48 +0000 (UTC) MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Date: Thu, 10 Jun 2021 15:54:44 -0000 From: Thomas Huth <1888714@bugs.launchpad.net> To: qemu-devel@nongnu.org X-Launchpad-Notification-Type: bug X-Launchpad-Bug: product=qemu; status=Confirmed; importance=Undecided; assignee=None; X-Launchpad-Bug-Tags: fuzzer test X-Launchpad-Bug-Information-Type: Public X-Launchpad-Bug-Private: no X-Launchpad-Bug-Security-Vulnerability: no X-Launchpad-Bug-Commenters: a1xndr th-huth X-Launchpad-Bug-Reporter: Alexander Bulekov (a1xndr) X-Launchpad-Bug-Modifier: Thomas Huth (th-huth) References: <159552501514.3414.9224287999042731513.malonedeb@gac.canonical.com> Message-Id: <162334048453.14381.2139631321617944721.malone@wampee.canonical.com> Subject: [Bug 1888714] Re: Memory Leak in hpet_timer results in unusable machine X-Launchpad-Message-Rationale: Subscriber (QEMU) @qemu-devel-ml X-Launchpad-Message-For: qemu-devel-ml Precedence: bulk X-Generated-By: Launchpad (canonical.com); Revision="b45bdbe3a00b6b668fa7f2069bd545c35c41f7f4"; Instance="production" X-Launchpad-Hash: a76c510811be9778944c6eb42d06688c8ae33a51 Received-SPF: none client-ip=91.189.90.7; envelope-from=bounces@canonical.com; helo=indium.canonical.com X-Spam_score_int: -65 X-Spam_score: -6.6 X-Spam_bar: ------ X-Spam_report: (-6.6 / 5.0 requ) BAYES_00=-1.9, HEADER_FROM_DIFFERENT_DOMAINS=0.249, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_NONE=0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: Bug 1888714 <1888714@bugs.launchpad.net> Errors-To: qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Sender: "Qemu-devel" Still reproduces with the current git version (commit 7fe7fae8b48e3f9c647) ** Tags added: fuzzer test ** Changed in: qemu Status: New =3D> Confirmed -- = You received this bug notification because you are a member of qemu- devel-ml, which is subscribed to QEMU. https://bugs.launchpad.net/bugs/1888714 Title: Memory Leak in hpet_timer results in unusable machine Status in QEMU: Confirmed Bug description: Fair warning: this might be specific to QTest (specifically its clock_step) command. This reproducer only works with -accel qtest. Build with --enable-sanitizers to exit once we hit 1G RSS. export ASAN_OPTIONS=3Dhard_rss_limit_mb=3D1000 = cat << EOF | ./i386-softmmu/qemu-system-i386 -nographic \ -nodefaults -qtest stdio -accel qtest writeq 0xfed0000e 0x15151515151515f1 clock_step clock_step clock_step clock_step writeq 0xfed00100 0x5e90c5be00ff5e9e writeq 0xfed00109 0xffffe0ff5cfec0ff clock_step EOF On my machine it takes around 10 seconds to reach the RSS limit. Unfortunately, I can't find a way to tell ASAN to log each malloc to figure out whats going on, but running the original fuzzing test case with the libfuzzer -trace_malloc=3D2 flag, I found that the allocations happen here: MALLOC[130968] 0x60300069ac90 32 #0 0x55fa3f615851 in __sanitizer_print_stack_trace (/home/alxndr/Deve= lopment/qemu/build/i386-softmmu/qemu-fuzz-i386+0x2683851) #1 0x55fa3f55fe88 in fuzzer::PrintStackTrace() (/home/alxndr/Developm= ent/qemu/build/i386-softmmu/qemu-fuzz-i386+0x25cde88) #2 0x55fa3f5447d6 in fuzzer::MallocHook(void const volatile*, unsigne= d long) (/home/alxndr/Development/qemu/build/i386-softmmu/qemu-fuzz-i386+0x= 25b27d6) #3 0x55fa3f61bbb7 in __sanitizer::RunMallocHooks(void const*, unsigne= d long) (/home/alxndr/Development/qemu/build/i386-softmmu/qemu-fuzz-i386+0x= 2689bb7) #4 0x55fa3f596d75 in __asan::Allocator::Allocate(unsigned long, unsig= ned long, __sanitizer::BufferedStackTrace*, __asan::AllocType, bool) (/home= /alxndr/Development/qemu/build/i386-softmmu/qemu-fuzz-i386+0x2604d75) #5 0x55fa3f596f7a in __asan::asan_calloc(unsigned long, unsigned long= , __sanitizer::BufferedStackTrace*) (/home/alxndr/Development/qemu/build/i3= 86-softmmu/qemu-fuzz-i386+0x2604f7a) #6 0x55fa3f60d173 in calloc (/home/alxndr/Development/qemu/build/i386= -softmmu/qemu-fuzz-i386+0x267b173) #7 0x7fb300737548 in g_malloc0 (/usr/lib/x86_64-linux-gnu/libglib-2.0= .so.0+0x54548) #8 0x55fa40157689 in async_run_on_cpu /home/alxndr/Development/qemu/c= pus-common.c:163:10 #9 0x55fa409fab83 in hpet_timer /home/alxndr/Development/qemu/hw/time= r/hpet.c:376:9 #10 0x55fa416a5751 in timerlist_run_timers /home/alxndr/Development/q= emu/util/qemu-timer.c:572:9 #11 0x55fa3fcfdac4 in qtest_clock_warp /home/alxndr/Development/qemu/= softmmu/cpus.c:507:9 #12 0x55fa3fd65c35 in qtest_process_command /home/alxndr/Development/= qemu/softmmu/qtest.c:665:9 #13 0x55fa3fd5e128 in qtest_process_inbuf /home/alxndr/Development/qe= mu/softmmu/qtest.c:710:9 #14 0x55fa3fd5de67 in qtest_server_inproc_recv /home/alxndr/Developme= nt/qemu/softmmu/qtest.c:817:9 #15 0x55fa4142b64b in qtest_sendf /home/alxndr/Development/qemu/tests= /qtest/libqtest.c:424:5 #16 0x55fa4142c482 in qtest_clock_step_next /home/alxndr/Development/= qemu/tests/qtest/libqtest.c:864:5 #17 0x55fa414b12d1 in general_fuzz /home/alxndr/Development/qemu/test= s/qtest/fuzz/general_fuzz.c:581:17 It doesn't look like we ever exit out of the loop in timerlist_run_timers, ie timer_list->active_timers is always True. = Info From GDB: #0 0x0000555558070d31 in address_space_stl_internal (as=3D0x55555f0e8f20= , addr=3D0x0, val=3D0x0, attrs=3D..., result=3D0x0, = endian=3DDEVICE_LITTLE_ENDIAN) at /home/alxndr/Development/qemu/memory_ldst= .inc.c:323 #1 0x0000555558071339 in address_space_stl_le (as=3D0x55555f0e8f20 , addr=3D0x0, val=3D0x0, attrs=3D..., result=3D0x0) at /ho= me/alxndr/Development/qemu/memory_ldst.inc.c:357 #2 0x000055555a6a6f95 in update_irq (timer=3D0x61f0000005b8, set=3D0x1) = at /home/alxndr/Development/qemu/hw/timer/hpet.c:210 #3 0x000055555a6ae55f in hpet_timer (opaque=3D0x61f0000005b8) at /home/a= lxndr/Development/qemu/hw/timer/hpet.c:386 #4 0x000055555c03d178 in timerlist_run_timers (timer_list=3D0x60b0000528= f0) at /home/alxndr/Development/qemu/util/qemu-timer.c:572 #5 0x000055555c03d6b5 in qemu_clock_run_timers (type=3DQEMU_CLOCK_VIRTUA= L) at /home/alxndr/Development/qemu/util/qemu-timer.c:586 #6 0x0000555558c3d0c4 in qtest_clock_warp (dest=3D0x3461864) at /home/al= xndr/Development/qemu/softmmu/cpus.c:507 = -Alex To manage notifications about this bug go to: https://bugs.launchpad.net/qemu/+bug/1888714/+subscriptions