Linux-EROFS Archive mirror
 help / color / mirror / Atom feed
From: Yifan Zhao <zhaoyifan@sjtu.edu.cn>
To: hsiangkao@linux.alibaba.com
Cc: linux-erofs@lists.ozlabs.org
Subject: [PATCH v4 0/5] erofs-utils: mkfs: introduce multi-threaded compression
Date: Thu, 29 Feb 2024 00:16:47 +0800	[thread overview]
Message-ID: <20240228161652.1010997-1-zhaoyifan@sjtu.edu.cn> (raw)

changelog since v3:
- remove unnecessary struct z_erofs_write_index_ctx, and add a
  helper z_erofs_mt_fix_index to fix extents->blkaddr before
  writing index
- rename: z_erofs_vle_compress_ctx -> z_erofs_compressed_segment_ctx
- rename: z_erofs_file_compress_ctx -> z_erofs_compressed_inode_ctx
- leave tryrecompress_trailing() unchanged as it's only used in
  ztailpacking scenario which is not supported yet  

Gao Xiang (2):
  erofs-utils: add a helper to get available processors
  erofs-utils: lib: introduce atomic operations

Yifan Zhao (3):
  erofs-utils: introduce multi-threading framework
  erofs-utils: mkfs: add --worker=# parameter
  erofs-utils: mkfs: introduce inner-file multi-threaded compression

 configure.ac                |  17 +
 include/erofs/atomic.h      |  28 ++
 include/erofs/compress.h    |   1 +
 include/erofs/config.h      |   5 +
 include/erofs/internal.h    |   3 +
 include/erofs/workqueue.h   |  37 ++
 lib/Makefile.am             |   4 +
 lib/compress.c              | 703 +++++++++++++++++++++++++++++-------
 lib/compressor.c            |   2 +
 lib/compressor_deflate.c    |  11 +-
 lib/compressor_libdeflate.c |   6 +-
 lib/compressor_liblzma.c    |   5 +-
 lib/config.c                |  16 +
 lib/workqueue.c             | 132 +++++++
 mkfs/main.c                 |  38 ++
 15 files changed, 877 insertions(+), 131 deletions(-)
 create mode 100644 include/erofs/atomic.h
 create mode 100644 include/erofs/workqueue.h
 create mode 100644 lib/workqueue.c

-- 
2.44.0


             reply	other threads:[~2024-02-28 16:17 UTC|newest]

Thread overview: 10+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2024-02-28 16:16 Yifan Zhao [this message]
2024-02-28 16:16 ` [PATCH v4 1/5] erofs-utils: introduce multi-threading framework Yifan Zhao
2024-02-29  9:43   ` Gao Xiang
2024-02-29  9:50     ` Gao Xiang
2024-02-29 12:09     ` Yifan Zhao
2024-02-28 16:16 ` [PATCH v4 2/5] erofs-utils: add a helper to get available processors Yifan Zhao
2024-02-28 16:16 ` [PATCH v4 3/5] erofs-utils: mkfs: add --worker=# parameter Yifan Zhao
2024-02-29  9:55   ` Gao Xiang
2024-02-28 16:16 ` [PATCH v4 4/5] erofs-utils: lib: introduce atomic operations Yifan Zhao
2024-02-28 16:16 ` [PATCH v4 5/5] erofs-utils: mkfs: introduce inner-file multi-threaded compression Yifan Zhao

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20240228161652.1010997-1-zhaoyifan@sjtu.edu.cn \
    --to=zhaoyifan@sjtu.edu.cn \
    --cc=hsiangkao@linux.alibaba.com \
    --cc=linux-erofs@lists.ozlabs.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).