Linux-EROFS Archive mirror
 help / color / mirror / Atom feed
From: Yifan Zhao <zhaoyifan@sjtu.edu.cn>
To: linux-erofs@lists.ozlabs.org, hsiangkao@linux.alibaba.com
Cc: zhaoyifan@sjtu.edu.cn
Subject: [PATCH v6 0/5] erofs-utils: mkfs: introduce multi-threaded compression
Date: Thu, 14 Mar 2024 20:37:49 +0800	[thread overview]
Message-ID: <20240314123754.1548878-1-zhaoyifan@sjtu.edu.cn> (raw)

changelog since v5:
- use memory buffer instead of tmpfile to store intermediate compressed data
- re-strucutre the 5th patch

Gao Xiang (2):
  erofs-utils: add a helper to get available processors
  erofs-utils: lib: introduce atomic operations

Yifan Zhao (3):
  erofs-utils: introduce multi-threading framework
  erofs-utils: mkfs: add --worker=# parameter
  erofs-utils: mkfs: introduce inner-file multi-threaded compression

 configure.ac                |  17 ++
 include/erofs/atomic.h      |  28 ++
 include/erofs/compress.h    |   3 +-
 include/erofs/config.h      |   5 +
 include/erofs/internal.h    |   3 +
 include/erofs/workqueue.h   |  35 +++
 lib/Makefile.am             |   4 +
 lib/compress.c              | 551 +++++++++++++++++++++++++++++-------
 lib/compressor.c            |   2 +
 lib/compressor_deflate.c    |  11 +-
 lib/compressor_libdeflate.c |   6 +-
 lib/compressor_liblzma.c    |   5 +-
 lib/config.c                |  16 ++
 lib/workqueue.c             | 129 +++++++++
 mkfs/main.c                 |  37 +++
 15 files changed, 750 insertions(+), 102 deletions(-)
 create mode 100644 include/erofs/atomic.h
 create mode 100644 include/erofs/workqueue.h
 create mode 100644 lib/workqueue.c

-- 
2.44.0


             reply	other threads:[~2024-03-14 12:38 UTC|newest]

Thread overview: 8+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2024-03-14 12:37 Yifan Zhao [this message]
2024-03-14 12:37 ` [PATCH v6 1/5] erofs-utils: introduce multi-threading framework Yifan Zhao
2024-03-14 12:37 ` [PATCH v6 2/5] erofs-utils: add a helper to get available processors Yifan Zhao
2024-03-14 12:37 ` [PATCH v6 3/5] erofs-utils: mkfs: add --worker=# parameter Yifan Zhao
2024-03-14 12:37 ` [PATCH v6 4/5] erofs-utils: lib: introduce atomic operations Yifan Zhao
2024-03-14 12:37 ` [PATCH v6 5/5] erofs-utils: mkfs: introduce inner-file multi-threaded compression Yifan Zhao
2024-03-15  2:39   ` Gao Xiang
2024-03-15  3:32     ` Gao Xiang

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20240314123754.1548878-1-zhaoyifan@sjtu.edu.cn \
    --to=zhaoyifan@sjtu.edu.cn \
    --cc=hsiangkao@linux.alibaba.com \
    --cc=linux-erofs@lists.ozlabs.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).