kernel-testers.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Mel Gorman <mel@csn.ul.ie>
To: Frans Pop <elendil@planet.nl>
Cc: Chris Mason <chris.mason@oracle.com>,
	David Rientjes <rientjes@google.com>,
	KOSAKI Motohiro <kosaki.motohiro@jp.fujitsu.com>,
	"Rafael J. Wysocki" <rjw@sisk.pl>,
	Linux Kernel Mailing List <linux-kernel@vger.kernel.org>,
	Kernel Testers List <kernel-testers@vger.kernel.org>,
	Pekka Enberg <penberg@cs.helsinki.fi>,
	Reinette Chatre <reinette.chatre@intel.com>,
	Bartlomiej Zolnierkiewicz <bzolnier@gmail.com>,
	Karol Lewandowski <karol.k.lewandowski@gmail.com>,
	Mohamed Abbas <mohamed.abbas@intel.com>,
	Jens Axboe <jens.axboe@oracle.com>,
	"John W. Linville" <linville@tuxdriver.com>,
	linux-mm@kvack.org
Subject: Re: [Bug #14141] order 2 page allocation failures in iwlagn
Date: Mon, 9 Nov 2009 19:00:59 +0000	[thread overview]
Message-ID: <20091109190059.GH6657@csn.ul.ie> (raw)
In-Reply-To: <200911061051.40443.elendil@planet.nl>

On Fri, Nov 06, 2009 at 10:51:37AM +0100, Frans Pop wrote:
> On Thursday 05 November 2009, Frans Pop wrote:
> > On Monday 26 October 2009, Frans Pop wrote:
> > > On Tuesday 20 October 2009, Mel Gorman wrote:
> > > > I've attached a patch below that should allow us to cheat. When it's
> > > > applied, it outputs who called congestion_wait(), how long the
> > > > timeout was and how long it waited for. By comparing before and
> > > > after sleep times, we should be able to see which of the callers has
> > > > significantly changed and if it's something easily addressable.
> > >
> > > The results from this look fairly interesting (although I may be a bad
> > > judge as I don't really know what I'm looking at ;-).
> > >
> > > I've tested with two kernels:
> > > 1) 2.6.31.1: 1 test run
> > > 2) 2.6.31.1 + congestion_wait() reverts: 2 test runs
> >
> > I've taken another look at the data from this debug patch, resulting in
> > these graphs: http://people.debian.org/~fjp/tmp/kernel/congestion.pdf
> >
> > I think the graph may show the reason for the congestion_wait()
> > regression. Horizontal axis shows time, vertical axis shows number of
> > logged congestion_wait calls per type.
> 
> I'm sorry. My initial version had a skewed time axis (showed occurrences 
> instead of actual time). I've now uploaded a corrected version:
> http://people.debian.org/~fjp/tmp/kernel/congestion.pdf
> 
> I've also uploaded a second version that shows cumulative delay per type, 
> which probably gives a better insight:
> http://people.debian.org/~fjp/tmp/kernel/congestion2.pdf
> 
> For both the top chart is without the revert, the bottom one after the 
> revert.
> 

I'm looking into this at the moment. There are some definite
differences not only in the length congestion_wait() is waiting but in
what the callers are doing. I've more or less reproduced your results
locally and am slowly plodding through each caller to see what has
changed of significance. No patches yet though.

-- 
Mel Gorman
Part-time Phd Student                          Linux Technology Center
University of Limerick                         IBM Dublin Software Lab

  reply	other threads:[~2009-11-09 19:00 UTC|newest]

Thread overview: 179+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2009-10-01 19:53 2.6.32-rc1-git2: Reported regressions 2.6.30 -> 2.6.31 Rafael J. Wysocki
2009-10-01 19:53 ` [Bug #13645] NULL pointer dereference at (null) (level2_spare_pgt) Rafael J. Wysocki
2009-10-01 19:55 ` [Bug #13836] suspend script fails, related to stdout? Rafael J. Wysocki
2009-10-01 19:55 ` [Bug #13733] 2.6.31-rc2: irq 16: nobody cared Rafael J. Wysocki
2009-10-01 19:55 ` [Bug #13809] oprofile: possible circular locking dependency detected Rafael J. Wysocki
2009-10-01 19:55 ` [Bug #13869] Radeon framebuffer (w/o KMS) corruption at boot Rafael J. Wysocki
2009-10-01 19:55 ` [Bug #13906] Huawei E169 GPRS connection causes Ooops Rafael J. Wysocki
2009-10-01 19:55 ` [Bug #13940] iwlagn and sky2 stopped working, ACPI-related Rafael J. Wysocki
2009-10-01 19:55 ` [Bug #13935] 2.6.31-rcX breaks Apple MightyMouse (Bluetooth version) Rafael J. Wysocki
2009-10-02 12:51   ` Jan Scholz
2009-10-02 15:58   ` Jiri Kosina
     [not found]     ` <alpine.LSU.2.00.0910021757390.10941-B4tOwbsTzaBolqkO4TVVkw@public.gmane.org>
2009-10-02 17:16       ` Rafael J. Wysocki
2009-10-01 19:55 ` [Bug #13948] ath5k broken after suspend-to-ram Rafael J. Wysocki
2009-10-01 19:55 ` [Bug #13943] WARNING: at net/mac80211/mlme.c:2292 with ath5k Rafael J. Wysocki
2009-10-02  7:12   ` Fabio Comolli
     [not found]     ` <b637ec0b0910020012n57e110cbl180aa5bda318e5d5-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2009-10-02 17:17       ` Rafael J. Wysocki
     [not found]         ` <200910021917.31509.rjw-KKrjLPT3xs0@public.gmane.org>
2009-10-02 21:37           ` Fabio Comolli
     [not found]             ` <b637ec0b0910021437l5a011f13qfa4dd541607a6dfb-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2009-10-02 21:42               ` Rafael J. Wysocki
     [not found]                 ` <200910022342.47977.rjw-KKrjLPT3xs0@public.gmane.org>
2009-10-03 13:36                   ` Fabio Comolli
2009-10-01 19:55 ` [Bug #13942] Troubles with AoE and uninitialized object Rafael J. Wysocki
2009-10-02 19:36   ` Bruno Prémont
     [not found]     ` <20091002213630.42c73909-hY15tx4IgV39zxVx7UNMDg@public.gmane.org>
2009-10-02 21:24       ` Rafael J. Wysocki
2009-10-02 19:57   ` David Rientjes
2009-10-01 19:55 ` [Bug #13941] x86 Geode issue Rafael J. Wysocki
2009-10-01 19:55 ` [Bug #13950] Oops when USB Serial disconnected while in use Rafael J. Wysocki
2009-10-02 19:45   ` Bruno Prémont
     [not found]     ` <20091002214550.6727df5c-hY15tx4IgV39zxVx7UNMDg@public.gmane.org>
2009-10-02 21:26       ` Rafael J. Wysocki
2009-10-01 19:55 ` [Bug #14013] hd don't show up Rafael J. Wysocki
2009-10-01 19:55 ` [Bug #14017] _end symbol missing from Symbol.map Rafael J. Wysocki
2009-10-01 19:55 ` [Bug #13987] Received NMI interrupt at resume Rafael J. Wysocki
2009-10-01 19:55 ` [Bug #14090] WARNING: at fs/notify/inotify/inotify_user.c:394 Rafael J. Wysocki
2009-10-01 19:55 ` [Bug #14070] lockdep warning triggered by dup_fd Rafael J. Wysocki
2009-10-01 19:55 ` [Bug #14058] Oops in fsnotify Rafael J. Wysocki
2009-10-02  7:14   ` Jaswinder Singh Rajput
2009-10-01 19:55 ` [Bug #14133] WARNING: at arch/x86/kernel/smp.c:117 native_smp_send_reschedule Rafael J. Wysocki
2009-10-02  7:00   ` Jaswinder Singh Rajput
2009-10-02  7:34     ` Jens Axboe
     [not found]       ` <20091002073425.GA14918-tSWWG44O7X1aa/9Udqfwiw@public.gmane.org>
2009-10-02 17:21         ` Rafael J. Wysocki
2009-10-01 19:55 ` [Bug #14137] usb console regressions Rafael J. Wysocki
2009-10-01 19:55 ` [Bug #14114] Tuning a saa7134 based card is broken in kernel 2.6.31-rc7 Rafael J. Wysocki
2009-10-01 19:55 ` [Bug #14157] end_request: I/O error, dev cciss/cXdX, sector 0 Rafael J. Wysocki
2009-10-01 19:55 ` [Bug #14141] order 2 page allocation failures in iwlagn Rafael J. Wysocki
2009-10-02  9:11   ` Frans Pop
     [not found]     ` <200910021111.55749.elendil-EIBgga6/0yRmR6Xm/wNWPw@public.gmane.org>
2009-10-02  9:32       ` Mel Gorman
     [not found]         ` <20091002093226.GJ21906-wPRd99KPJ+uzQB+pC5nmwQ@public.gmane.org>
2009-10-02 10:01           ` Frans Pop
2009-10-02 20:01           ` Karol Lewandowski
2009-10-04 19:28             ` Karol Lewandowski
2009-10-05  5:13     ` Frans Pop
2009-10-05  6:50       ` Frans Pop
2009-10-05  8:54         ` Frans Pop
2009-10-05  8:57         ` Mel Gorman
2009-10-05 21:34           ` Frans Pop
2009-10-06  0:04             ` David Rientjes
2009-10-06  1:25               ` KOSAKI Motohiro
2009-10-06  8:53               ` Mel Gorman
2009-10-06  9:14                 ` David Rientjes
2009-10-06  9:22                   ` Mel Gorman
2009-10-06 10:23               ` Frans Pop
2009-10-11 23:10         ` Frans Pop
2009-10-11 23:36           ` Frans Pop
2009-10-12 13:43           ` Mel Gorman
2009-10-12 17:32             ` Frans Pop
2009-10-12 18:43               ` Mel Gorman
2009-10-13 20:38               ` Frans Pop
2009-10-14 10:30                 ` Mel Gorman
2009-10-14 13:10                   ` Frans Pop
2009-10-14 15:40                     ` Mel Gorman
2009-10-14 16:13                       ` Frans Pop
2009-10-14 18:34                       ` Frans Pop
2009-10-14 23:56                         ` Mel Gorman
2009-10-15 20:15                           ` Frans Pop
2009-10-16  9:39                             ` Mel Gorman
2009-10-14 16:30                     ` reinette chatre
     [not found]                     ` <200910141510.11059.elendil-EIBgga6/0yRmR6Xm/wNWPw@public.gmane.org>
2009-10-18 23:33                       ` Frans Pop
2009-10-19  0:36                         ` Pekka Enberg
2009-10-19  2:44                           ` Frans Pop
2009-10-19  9:49                             ` [Bug #14141] order 2 page allocation failures (generic) Tobi Oetiker
     [not found]                               ` <alpine.DEB.2.00.0910191146110.1306-EjsAmf5DE5zIvOfxy3zmAzgUDZmNtoG9@public.gmane.org>
2009-10-19  9:54                                 ` Pekka Enberg
2009-10-19 14:01                                   ` Karol Lewandowski
     [not found]                                     ` <20091019140145.GA4222-nLtalAL5mPp2RxbNQum0x1nzlInOXLuq@public.gmane.org>
2009-10-19 14:06                                       ` Mel Gorman
2009-10-19 17:09                                         ` Karol Lewandowski
2009-10-20  1:47                                           ` Karol Lewandowski
2009-10-19 13:31                                 ` Mel Gorman
     [not found]                                   ` <20091019133146.GB9036-wPRd99KPJ+uzQB+pC5nmwQ@public.gmane.org>
2009-10-19 13:40                                     ` Tobias Oetiker
     [not found]                                       ` <alpine.DEB.2.00.0910191538450.8526-EjsAmf5DE5zIvOfxy3zmAzgUDZmNtoG9@public.gmane.org>
2009-10-19 14:09                                         ` Mel Gorman
2009-10-19  2:52                           ` [Bug #14141] order 2 page allocation failures in iwlagn Jens Axboe
     [not found]                         ` <200910190133.33183.elendil-EIBgga6/0yRmR6Xm/wNWPw@public.gmane.org>
2009-10-19 14:01                           ` Mel Gorman
2009-10-19 16:18                             ` Chris Mason
2009-10-19 17:01                               ` Christoph Hellwig
     [not found]                                 ` <20091019170115.GA4593-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org>
2009-10-19 21:57                                   ` Chris Mason
2009-10-20 10:48                               ` Mel Gorman
2009-10-26 21:06                                 ` Frans Pop
     [not found]                                   ` <200910262206.13146.elendil-EIBgga6/0yRmR6Xm/wNWPw@public.gmane.org>
2009-10-27 14:54                                     ` Mel Gorman
2009-10-27 15:16                                       ` KOSAKI Motohiro
     [not found]                                         ` <2f11576a0910270816s3e1b268ah91b5f2d0cc0d562e-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2009-10-27 15:21                                           ` Mel Gorman
     [not found]                                       ` <20091027145435.GG8900-wPRd99KPJ+uzQB+pC5nmwQ@public.gmane.org>
2009-10-27 15:52                                         ` Mel Gorman
2009-10-27 16:03                                           ` Chris Mason
2009-10-27 17:21                                             ` Frans Pop
2009-11-05 20:14                                     ` Frans Pop
     [not found]                                       ` <200911052114.36718.elendil-EIBgga6/0yRmR6Xm/wNWPw@public.gmane.org>
2009-11-06  9:51                                         ` Frans Pop
2009-11-09 19:00                                           ` Mel Gorman [this message]
2009-10-25 18:54                               ` Frans Pop
2009-10-14 16:28                   ` reinette chatre
2009-10-14 16:50                     ` Mel Gorman
2009-10-14 20:41                       ` reinette chatre
2009-10-14 21:33                         ` Frans Pop
2009-10-14 21:55                           ` reinette chatre
2009-10-15  2:02                         ` Frans Pop
2009-10-15 15:29                           ` reinette chatre
2009-10-15 19:41                             ` Frans Pop
2009-10-16 17:21                               ` reinette chatre
     [not found]                               ` <200910152142.02876.elendil-EIBgga6/0yRmR6Xm/wNWPw@public.gmane.org>
2009-10-17  5:42                                 ` reinette chatre
2009-10-27 11:10                                   ` Frans Pop
     [not found]                                     ` <200910271210.31014.elendil-EIBgga6/0yRmR6Xm/wNWPw@public.gmane.org>
2009-10-27 16:15                                       ` reinette chatre
2009-10-01 19:55 ` [Bug #14143] OOPS when setting nr_requests for md devices Rafael J. Wysocki
2009-10-01 19:55 ` [Bug #14181] b43 causes panic at system shutdown Rafael J. Wysocki
2009-10-01 19:55 ` [Bug #14205] Intel DX58SO mainboard - powering off takes really long Rafael J. Wysocki
2009-10-01 19:55 ` [Bug #14204] MCE prevent booting on my computer(pentium iii @500Mhz) Rafael J. Wysocki
2009-10-01 19:55 ` [Bug #14185] Oops in driversbasefirmware_class Rafael J. Wysocki
2009-10-01 19:56 ` [Bug #14248] 2.6.31 wireless: WARNING: at net/wireless/ibss.c:34 Rafael J. Wysocki
2009-10-01 19:56 ` [Bug #14222] Hibernation oopses for the 2nd time with 2.6.31 (won't fit the screen) Rafael J. Wysocki
2009-10-01 19:56 ` [Bug #14249] BUG: oops in gss_validate on 2.6.31 Rafael J. Wysocki
2009-10-01 19:56 ` [Bug #14254] Hibernation broken by clocksource: Save mult_orig in clocksource_disable() Rafael J. Wysocki
2009-10-01 19:56 ` [Bug #14253] Oops in driversbasefirmware_class Rafael J. Wysocki
2009-10-01 19:56 ` [Bug #14251] 2.6.31: no login prompt Rafael J. Wysocki
2009-10-01 19:56 ` [Bug #14252] WARNING: at include/linux/skbuff.h:1382 w/ e1000 Rafael J. Wysocki
2009-10-01 19:56 ` [Bug #14256] kernel BUG at fs/ext3/super.c:435 Rafael J. Wysocki
2009-10-04 17:38   ` Mikael Pettersson
2009-10-04 20:49     ` Rafael J. Wysocki
     [not found]       ` <200910042249.54639.rjw-KKrjLPT3xs0@public.gmane.org>
2009-10-04 23:04         ` Mikael Pettersson
     [not found]           ` <19145.10741.402938.867088-tgku4HJDRZih8lFjZTKsyTAV6s6igYVG@public.gmane.org>
2009-10-09 16:40             ` Mikael Pettersson
     [not found]               ` <19151.26501.727411.584056-tgku4HJDRZih8lFjZTKsyTAV6s6igYVG@public.gmane.org>
2009-10-09 22:03                 ` Rafael J. Wysocki
2009-10-01 19:56 ` [Bug #14255] WARNING: at drivers/char/tty_io.c:1267 Rafael J. Wysocki
2009-10-02  0:05   ` Linus Torvalds
2009-10-01 19:56 ` [Bug #14257] Not able to boot on 32 bit System Rafael J. Wysocki
2009-10-01 19:56 ` [Bug #14258] Memory leak in SCSI initialization Rafael J. Wysocki
2009-10-02 12:58   ` Tetsuo Handa
2009-10-02 17:26     ` Rafael J. Wysocki
2009-10-07 14:04       ` Tetsuo Handa
2009-10-07 20:24         ` Rafael J. Wysocki
2009-10-01 19:56 ` [Bug #14264] ehci problem - mouse dead on scroll Rafael J. Wysocki
2009-10-01 19:56 ` [Bug #14261] e1000e jumbo frames no longer work: 'Unsupported MTU setting' Rafael J. Wysocki
2009-10-02 20:33   ` Nix
     [not found]     ` <877hvd8rj5.fsf-AdTWujXS48Mg67Zj9sPl2A@public.gmane.org>
2009-10-02 21:31       ` Rafael J. Wysocki
2009-10-02 22:13         ` Jeff Kirsher
2009-10-07 18:34           ` Theodore Tso
     [not found]             ` <20091007183453.GD12971-3s7WtUTddSA@public.gmane.org>
2009-10-07 19:12               ` Jeff Kirsher
2009-10-01 19:56 ` [Bug #14266] regression in page writeback Rafael J. Wysocki
2009-10-01 19:56 ` [Bug #14270] Cannot boot on a PIII Celeron Rafael J. Wysocki
2009-10-02  8:30   ` Cyrill Gorcunov
     [not found]     ` <aa79d98a0910020130p4d3c5b5fh9597ea435db7f872-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2009-10-02  9:13       ` Michael Tokarev
     [not found]         ` <4AC5C42E.9070909-Gdu+ltImwkhes2APU0mLOQ@public.gmane.org>
2009-10-02 10:38           ` Michael Tokarev
2009-10-02 10:55             ` Cyrill Gorcunov
     [not found]               ` <aa79d98a0910020355r31b37ea0v1fef7286f7a71508-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2009-10-02 10:59                 ` Michael Tokarev
2009-10-02 14:05                   ` Cyrill Gorcunov
2009-10-01 19:56 ` [Bug #14265] ifconfig: page allocation failure. order:5, mode:0x8020 w/ e100 Rafael J. Wysocki
2009-10-21 20:04   ` [PATCH] SLUB: Don't drop __GFP_NOFAIL completely from allocate_slab() (was: Re: [Bug #14265] ifconfig: page allocation failure. order:5,ode:0x8020 w/ e100) Karol Lewandowski
     [not found]     ` <20091021200442.GA2987-nLtalAL5mPp2RxbNQum0x1nzlInOXLuq@public.gmane.org>
2009-10-21 21:06       ` David Rientjes
     [not found]         ` <alpine.DEB.2.00.0910211400140.20010-X6Q0R45D7oAcqpCFd4KODRPsWskHk0ljAL8bYrjMMd8@public.gmane.org>
2009-10-21 21:20           ` Karol Lewandowski
2009-10-22 10:20             ` Mel Gorman
     [not found]               ` <20091022102014.GL11778-wPRd99KPJ+uzQB+pC5nmwQ@public.gmane.org>
2009-10-22 21:33                 ` Karol Lewandowski
2009-10-01 19:56 ` [Bug #14267] Disassociating atheros wlan Rafael J. Wysocki
2009-10-05  0:34   ` Justin Mattock
2009-10-05 20:09     ` Rafael J. Wysocki
2009-10-01 19:56 ` [Bug #14275] kernel>=2.6.31: ahci.c: do not force unconditionally sb600 to 32bit dma any more? Rafael J. Wysocki
2009-10-01 19:56 ` [Bug #14294] kernel BUG at drivers/ide/ide-disk.c:187 Rafael J. Wysocki
2009-10-01 19:56 ` [Bug #14301] WARNING: at net/ipv4/af_inet.c:154 Rafael J. Wysocki
2009-10-03  8:36   ` Eric Dumazet
     [not found]     ` <4AC70D20.4060009-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
2009-10-03  8:52       ` Eric Dumazet
2009-10-03 17:53         ` Eric Dumazet
     [not found]           ` <4AC78F7C.40908-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
2009-10-07 15:41             ` Eric Dumazet
2009-10-09 14:43               ` [PATCH] udp: Fix udp_poll() and ioctl() Eric Dumazet
     [not found]                 ` <4ACF4C1C.4050505-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
2009-10-13 10:18                   ` David Miller
  -- strict thread matches above, loose matches on Subject: below --
2009-10-11 22:41 2.6.32-rc4: Reported regressions 2.6.30 -> 2.6.31 Rafael J. Wysocki
2009-10-11 23:01 ` [Bug #14141] order 2 page allocation failures in iwlagn Rafael J. Wysocki
2009-10-11 23:57   ` Frans Pop
     [not found]     ` <200910120157.04616.elendil-EIBgga6/0yRmR6Xm/wNWPw@public.gmane.org>
2009-10-12 21:29       ` Rafael J. Wysocki
2009-10-26 19:26 2.6.32-rc5-git3: Reported regressions 2.6.30 -> 2.6.31 Rafael J. Wysocki
2009-10-26 19:31 ` [Bug #14141] order 2 page allocation failures in iwlagn Rafael J. Wysocki
2009-11-16 22:58 2.6.32-rc7-git1: Reported regressions 2.6.30 -> 2.6.31 Rafael J. Wysocki
2009-11-16 23:01 ` [Bug #14141] order 2 page allocation failures in iwlagn Rafael J. Wysocki
2009-11-21 14:59 2.6.32-rc8-git1: Reported regressions 2.6.30 -> 2.6.31 Rafael J. Wysocki
2009-11-21 15:02 ` [Bug #14141] order 2 page allocation failures in iwlagn Rafael J. Wysocki

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20091109190059.GH6657@csn.ul.ie \
    --to=mel@csn.ul.ie \
    --cc=bzolnier@gmail.com \
    --cc=chris.mason@oracle.com \
    --cc=elendil@planet.nl \
    --cc=jens.axboe@oracle.com \
    --cc=karol.k.lewandowski@gmail.com \
    --cc=kernel-testers@vger.kernel.org \
    --cc=kosaki.motohiro@jp.fujitsu.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=linville@tuxdriver.com \
    --cc=mohamed.abbas@intel.com \
    --cc=penberg@cs.helsinki.fi \
    --cc=reinette.chatre@intel.com \
    --cc=rientjes@google.com \
    --cc=rjw@sisk.pl \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).