* [PATCH] mm/migrate_device: Try to handle swapcache pages.
@ 2023-05-07 6:17 mpenttil
2023-05-08 2:26 ` Huang, Ying
0 siblings, 1 reply; 5+ messages in thread
From: mpenttil @ 2023-05-07 6:17 UTC (permalink / raw
To: linux-kernel, linux-mm; +Cc: apopple, jhubbard, rcampbell, Mika Penttilä
From: Mika Penttilä <mpenttil@redhat.com>
Migrating file pages and swapcache pages into device memory is not supported.
The decision is done based on page_mapping(). For now, swapcache pages are not migrated.
Things can however be improved, for swapcache pages. Try to get rid of the swap cache,
and if successful, go ahead as with other anonymous pages.
As a detail, do not mess with shmem pages, as they handle swap internally.
Cc: Alistair Popple <apopple@nvidia.com>
Cc: John Hubbard <jhubbard@nvidia.com>
Cc: Ralph Campbell <rcampbell@nvidia.com>
Signed-off-by: Mika Penttilä <mpenttil@redhat.com>
---
mm/migrate_device.c | 12 ++++++++++--
1 file changed, 10 insertions(+), 2 deletions(-)
diff --git a/mm/migrate_device.c b/mm/migrate_device.c
index d30c9de60b0d..e8169c58c341 100644
--- a/mm/migrate_device.c
+++ b/mm/migrate_device.c
@@ -12,6 +12,7 @@
#include <linux/mmu_notifier.h>
#include <linux/oom.h>
#include <linux/pagewalk.h>
+#include <linux/shmem_fs.h>
#include <linux/rmap.h>
#include <linux/swapops.h>
#include <asm/tlbflush.h>
@@ -750,10 +751,17 @@ static void __migrate_device_pages(unsigned long *src_pfns,
/*
* For now only support anonymous memory migrating to
* device private or coherent memory.
+ *
+ * Try to get rid of swap cache if possible.
+ * Leave shmem pages alone, they handle swap internally
+ *
*/
if (mapping) {
- src_pfns[i] &= ~MIGRATE_PFN_MIGRATE;
- continue;
+ if (shmem_mapping(mapping) ||
+ !folio_free_swap(page_folio(page))) {
+ src_pfns[i] &= ~MIGRATE_PFN_MIGRATE;
+ continue;
+ }
}
} else if (is_zone_device_page(newpage)) {
/*
--
2.17.1
^ permalink raw reply related [flat|nested] 5+ messages in thread
* Re: [PATCH] mm/migrate_device: Try to handle swapcache pages.
2023-05-07 6:17 [PATCH] mm/migrate_device: Try to handle swapcache pages mpenttil
@ 2023-05-08 2:26 ` Huang, Ying
2023-05-08 2:59 ` Mika Penttilä
0 siblings, 1 reply; 5+ messages in thread
From: Huang, Ying @ 2023-05-08 2:26 UTC (permalink / raw
To: mpenttil; +Cc: linux-kernel, linux-mm, apopple, jhubbard, rcampbell
mpenttil@redhat.com writes:
> From: Mika Penttilä <mpenttil@redhat.com>
>
> Migrating file pages and swapcache pages into device memory is not supported.
> The decision is done based on page_mapping(). For now, swapcache pages are not migrated.
>
> Things can however be improved, for swapcache pages. Try to get rid of the swap cache,
> and if successful, go ahead as with other anonymous pages.
>
> As a detail, do not mess with shmem pages, as they handle swap internally.
>
> Cc: Alistair Popple <apopple@nvidia.com>
> Cc: John Hubbard <jhubbard@nvidia.com>
> Cc: Ralph Campbell <rcampbell@nvidia.com>
> Signed-off-by: Mika Penttilä <mpenttil@redhat.com>
> ---
> mm/migrate_device.c | 12 ++++++++++--
> 1 file changed, 10 insertions(+), 2 deletions(-)
>
> diff --git a/mm/migrate_device.c b/mm/migrate_device.c
> index d30c9de60b0d..e8169c58c341 100644
> --- a/mm/migrate_device.c
> +++ b/mm/migrate_device.c
> @@ -12,6 +12,7 @@
> #include <linux/mmu_notifier.h>
> #include <linux/oom.h>
> #include <linux/pagewalk.h>
> +#include <linux/shmem_fs.h>
> #include <linux/rmap.h>
> #include <linux/swapops.h>
> #include <asm/tlbflush.h>
> @@ -750,10 +751,17 @@ static void __migrate_device_pages(unsigned long *src_pfns,
> /*
> * For now only support anonymous memory migrating to
> * device private or coherent memory.
> + *
> + * Try to get rid of swap cache if possible.
> + * Leave shmem pages alone, they handle swap internally
> + *
> */
> if (mapping) {
> - src_pfns[i] &= ~MIGRATE_PFN_MIGRATE;
> - continue;
> + if (shmem_mapping(mapping) ||
> + !folio_free_swap(page_folio(page))) {
Should we filter out file pages firstly?
> + src_pfns[i] &= ~MIGRATE_PFN_MIGRATE;
> + continue;
> + }
> }
> } else if (is_zone_device_page(newpage)) {
> /*
Best Regards,
Huang, Ying
^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: [PATCH] mm/migrate_device: Try to handle swapcache pages.
2023-05-08 2:26 ` Huang, Ying
@ 2023-05-08 2:59 ` Mika Penttilä
2023-05-08 5:14 ` Huang, Ying
0 siblings, 1 reply; 5+ messages in thread
From: Mika Penttilä @ 2023-05-08 2:59 UTC (permalink / raw
To: Huang, Ying; +Cc: linux-kernel, linux-mm, apopple, jhubbard, rcampbell
H,
On 8.5.2023 5.26, Huang, Ying wrote:
> mpenttil@redhat.com writes:
>
>> From: Mika Penttilä <mpenttil@redhat.com>
>>
>> Migrating file pages and swapcache pages into device memory is not supported.
>> The decision is done based on page_mapping(). For now, swapcache pages are not migrated.
>>
>> Things can however be improved, for swapcache pages. Try to get rid of the swap cache,
>> and if successful, go ahead as with other anonymous pages.
>>
>> As a detail, do not mess with shmem pages, as they handle swap internally.
>>
>> Cc: Alistair Popple <apopple@nvidia.com>
>> Cc: John Hubbard <jhubbard@nvidia.com>
>> Cc: Ralph Campbell <rcampbell@nvidia.com>
>> Signed-off-by: Mika Penttilä <mpenttil@redhat.com>
>> ---
>> mm/migrate_device.c | 12 ++++++++++--
>> 1 file changed, 10 insertions(+), 2 deletions(-)
>>
>> diff --git a/mm/migrate_device.c b/mm/migrate_device.c
>> index d30c9de60b0d..e8169c58c341 100644
>> --- a/mm/migrate_device.c
>> +++ b/mm/migrate_device.c
>> @@ -12,6 +12,7 @@
>> #include <linux/mmu_notifier.h>
>> #include <linux/oom.h>
>> #include <linux/pagewalk.h>
>> +#include <linux/shmem_fs.h>
>> #include <linux/rmap.h>
>> #include <linux/swapops.h>
>> #include <asm/tlbflush.h>
>> @@ -750,10 +751,17 @@ static void __migrate_device_pages(unsigned long *src_pfns,
>> /*
>> * For now only support anonymous memory migrating to
>> * device private or coherent memory.
>> + *
>> + * Try to get rid of swap cache if possible.
>> + * Leave shmem pages alone, they handle swap internally
>> + *
>> */
>> if (mapping) {
>> - src_pfns[i] &= ~MIGRATE_PFN_MIGRATE;
>> - continue;
>> + if (shmem_mapping(mapping) ||
>> + !folio_free_swap(page_folio(page))) {
>
> Should we filter out file pages firstly?
folio_free_swap() checks first and returns false if not swapcache page
(ie including normal file pages) so think that is enough, but maybe for
clarity and not depending on it, could be good explicitly check for
swapcache before calling folio_free_swap().
>
>> + src_pfns[i] &= ~MIGRATE_PFN_MIGRATE;
>> + continue;
>> + }
>> }
>> } else if (is_zone_device_page(newpage)) {
>> /*
>
> Best Regards,
> Huang, Ying
>
Thanks,
Mika
^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: [PATCH] mm/migrate_device: Try to handle swapcache pages.
2023-05-08 2:59 ` Mika Penttilä
@ 2023-05-08 5:14 ` Huang, Ying
2023-05-08 5:57 ` Mika Penttilä
0 siblings, 1 reply; 5+ messages in thread
From: Huang, Ying @ 2023-05-08 5:14 UTC (permalink / raw
To: Mika Penttilä; +Cc: linux-kernel, linux-mm, apopple, jhubbard, rcampbell
Mika Penttilä <mpenttil@redhat.com> writes:
> H,
>
>
> On 8.5.2023 5.26, Huang, Ying wrote:
>> mpenttil@redhat.com writes:
>>
>>> From: Mika Penttil <mpenttil@redhat.com>
>>>
>>> Migrating file pages and swapcache pages into device memory is not supported.
>>> The decision is done based on page_mapping(). For now, swapcache pages are not migrated.
>>>
>>> Things can however be improved, for swapcache pages. Try to get rid of the swap cache,
>>> and if successful, go ahead as with other anonymous pages.
>>>
>>> As a detail, do not mess with shmem pages, as they handle swap internally.
>>>
>>> Cc: Alistair Popple <apopple@nvidia.com>
>>> Cc: John Hubbard <jhubbard@nvidia.com>
>>> Cc: Ralph Campbell <rcampbell@nvidia.com>
>>> Signed-off-by: Mika Penttil <mpenttil@redhat.com>
>>> ---
>>> mm/migrate_device.c | 12 ++++++++++--
>>> 1 file changed, 10 insertions(+), 2 deletions(-)
>>>
>>> diff --git a/mm/migrate_device.c b/mm/migrate_device.c
>>> index d30c9de60b0d..e8169c58c341 100644
>>> --- a/mm/migrate_device.c
>>> +++ b/mm/migrate_device.c
>>> @@ -12,6 +12,7 @@
>>> #include <linux/mmu_notifier.h>
>>> #include <linux/oom.h>
>>> #include <linux/pagewalk.h>
>>> +#include <linux/shmem_fs.h>
>>> #include <linux/rmap.h>
>>> #include <linux/swapops.h>
>>> #include <asm/tlbflush.h>
>>> @@ -750,10 +751,17 @@ static void __migrate_device_pages(unsigned long *src_pfns,
>>> /*
>>> * For now only support anonymous memory migrating to
>>> * device private or coherent memory.
>>> + *
>>> + * Try to get rid of swap cache if possible.
>>> + * Leave shmem pages alone, they handle swap internally
>>> + *
>>> */
>>> if (mapping) {
>>> - src_pfns[i] &= ~MIGRATE_PFN_MIGRATE;
>>> - continue;
>>> + if (shmem_mapping(mapping) ||
>>> + !folio_free_swap(page_folio(page))) {
>> Should we filter out file pages firstly?
>
> folio_free_swap() checks first and returns false if not swapcache page
> (ie including normal file pages) so think that is enough,
You are right. folio_free_swap() will call folio_test_swapcache(), and
which will check folio_test_swapbacked().
And, IIUC, we don't need to check shmem too. Because folio_free_swap()
will not return true for shmem pages.
> but maybe for clarity and not depending on it, could be good
> explicitly check for swapcache before calling folio_free_swap().
Yes. That will be more clear. I suggest to use folio_test_anon(), that
will filter out shmem pages too.
>>
>>> + src_pfns[i] &= ~MIGRATE_PFN_MIGRATE;
>>> + continue;
>>> + }
>>> }
>>> } else if (is_zone_device_page(newpage)) {
>>> /*
Best Regards,
Huang, Ying
^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: [PATCH] mm/migrate_device: Try to handle swapcache pages.
2023-05-08 5:14 ` Huang, Ying
@ 2023-05-08 5:57 ` Mika Penttilä
0 siblings, 0 replies; 5+ messages in thread
From: Mika Penttilä @ 2023-05-08 5:57 UTC (permalink / raw
To: Huang, Ying; +Cc: linux-kernel, linux-mm, apopple, jhubbard, rcampbell
Hi,
On 8.5.2023 8.14, Huang, Ying wrote:
> Mika Penttilä <mpenttil@redhat.com> writes:
>
>> H,
>>
>>
>> On 8.5.2023 5.26, Huang, Ying wrote:
>>> mpenttil@redhat.com writes:
>>>
>>>> From: Mika Penttil <mpenttil@redhat.com>
>>>>
>>>> Migrating file pages and swapcache pages into device memory is not supported.
>>>> The decision is done based on page_mapping(). For now, swapcache pages are not migrated.
>>>>
>>>> Things can however be improved, for swapcache pages. Try to get rid of the swap cache,
>>>> and if successful, go ahead as with other anonymous pages.
>>>>
>>>> As a detail, do not mess with shmem pages, as they handle swap internally.
>>>>
>>>> Cc: Alistair Popple <apopple@nvidia.com>
>>>> Cc: John Hubbard <jhubbard@nvidia.com>
>>>> Cc: Ralph Campbell <rcampbell@nvidia.com>
>>>> Signed-off-by: Mika Penttil <mpenttil@redhat.com>
>>>> ---
>>>> mm/migrate_device.c | 12 ++++++++++--
>>>> 1 file changed, 10 insertions(+), 2 deletions(-)
>>>>
>>>> diff --git a/mm/migrate_device.c b/mm/migrate_device.c
>>>> index d30c9de60b0d..e8169c58c341 100644
>>>> --- a/mm/migrate_device.c
>>>> +++ b/mm/migrate_device.c
>>>> @@ -12,6 +12,7 @@
>>>> #include <linux/mmu_notifier.h>
>>>> #include <linux/oom.h>
>>>> #include <linux/pagewalk.h>
>>>> +#include <linux/shmem_fs.h>
>>>> #include <linux/rmap.h>
>>>> #include <linux/swapops.h>
>>>> #include <asm/tlbflush.h>
>>>> @@ -750,10 +751,17 @@ static void __migrate_device_pages(unsigned long *src_pfns,
>>>> /*
>>>> * For now only support anonymous memory migrating to
>>>> * device private or coherent memory.
>>>> + *
>>>> + * Try to get rid of swap cache if possible.
>>>> + * Leave shmem pages alone, they handle swap internally
>>>> + *
>>>> */
>>>> if (mapping) {
>>>> - src_pfns[i] &= ~MIGRATE_PFN_MIGRATE;
>>>> - continue;
>>>> + if (shmem_mapping(mapping) ||
>>>> + !folio_free_swap(page_folio(page))) {
>>> Should we filter out file pages firstly?
>>
>> folio_free_swap() checks first and returns false if not swapcache page
>> (ie including normal file pages) so think that is enough,
>
> You are right. folio_free_swap() will call folio_test_swapcache(), and
> which will check folio_test_swapbacked().
>
> And, IIUC, we don't need to check shmem too. Because folio_free_swap()
> will not return true for shmem pages.
Ah yes true, for not written out shmem page folio_free_swap() returns
false (because !swapcache). And written out (but in swap cache) returns
false because folio_swapped() == true
>
>> but maybe for clarity and not depending on it, could be good
>> explicitly check for swapcache before calling folio_free_swap().
>
> Yes. That will be more clear. I suggest to use folio_test_anon(), that
> will filter out shmem pages too.
Agreed.
>
>>>
>>>> + src_pfns[i] &= ~MIGRATE_PFN_MIGRATE;
>>>> + continue;
>>>> + }
>>>> }
>>>> } else if (is_zone_device_page(newpage)) {
>>>> /*
>
> Best Regards,
> Huang, Ying
>
Thanks,
Mika
^ permalink raw reply [flat|nested] 5+ messages in thread
end of thread, other threads:[~2023-05-08 5:58 UTC | newest]
Thread overview: 5+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2023-05-07 6:17 [PATCH] mm/migrate_device: Try to handle swapcache pages mpenttil
2023-05-08 2:26 ` Huang, Ying
2023-05-08 2:59 ` Mika Penttilä
2023-05-08 5:14 ` Huang, Ying
2023-05-08 5:57 ` Mika Penttilä
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.