70 commits

Author	SHA1	Message	Date
Jiahao XU	a3ab3ec502	Add new static var REQWESTGLOBALCONFIG ... Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-23 13:01:22 +10:00
Jiahao XU	eb7d460a9a	Add new enum TLSVersion which impl ArgEnum ... and can be converted to `reqwest::tls::Version` Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-23 13:00:52 +10:00
Jiahao XU	8e92db3dc6	Refactor: Extract new_reqwest_client(_builder) ... Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-23 13:00:52 +10:00
Jiahao XU	74a6e137be	Refactor: Mv debug! into create_request ... Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-21 13:47:00 +10:00
Jiahao XU	621a641529	Rm unused items in mod helpers ... Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-18 18:10:22 +10:00
Jiahao XU	0480e99460	Impl newtype StreamReadable ... It wraps a `Stream<Item = Result<Bytes, E>>` and implements `Read` and `BufRead` on it so that it can be used on sync context. Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-18 17:29:50 +10:00
Jiahao XU	2091345ce0	Refactor: Mv TarEntriesVisitor to mod async_extracter ... Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-13 01:14:22 +10:00
Jiahao XU	225cf74cd9	Refactor: Ret impl Stream in create_request ... Since both `download*` function takes a `impl Stream` and the `Response::bytes_stream` takes `Response` by value, thus there is no lifetime issue and we can return `impl Stream` instead of `Response` Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-12 20:01:43 +10:00
Jiahao XU	e39549f470	Improve debug! logging in download_and_extract ... Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-12 17:08:22 +10:00
Jiahao XU	f25306ff97	Simplify download_tar_based_and_visit: Rm unused param ... `path` Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-12 17:07:29 +10:00
Jiahao XU	e376b71cf4	Simplify extract_tar_based_stream_and_visit ... Rm unused param `path` and the unnecessary `fs::create_dir_all` since the tar will not be extracted to disk. Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-12 17:05:35 +10:00
Jiahao XU	f82890cba3	Rm download_and_extract_with_filter ... Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-12 16:42:32 +10:00
Jiahao XU	cb2be5a882	Add new trait PathExt & impl for Path ... Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-12 01:46:10 +10:00
Jiahao XU	f8c8c66f57	Impl new fn helpers::download_tar_based_and_visit ... Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-11 20:38:11 +10:00
Jiahao XU	90a96cabc9	Rewrite untar to take a visitor & simplify ... signature of `download_and_extract_with_filter` Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-11 20:31:46 +10:00
Jiahao XU	d1033758a7	Update doc of download_and_extract_with_filter ... Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-11 20:15:17 +10:00
Jiahao XU	b1b79921b2	Simplify download_and_extract_with_filter: Take TarBasedFmt ... instead of `PkgFmt` Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-11 20:15:17 +10:00
Jiahao XU	cbd57a1bce	Refactor async_extracter: Create multi extracters ... dedicated to different tasks Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-11 20:15:17 +10:00
Jiahao XU	4c210fd2c3	Rm unused imports in mod helpers ... Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-11 12:59:41 +10:00
Jiahao XU	88c3f15b3f	Rename Confirmer to UIThread ... Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-11 12:59:27 +10:00
Jiahao XU	b2bf065a2b	Rm unused fn helpers::confirm::confirm ... Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-11 12:59:26 +10:00
Jiahao XU	dd2fa2de33	Impl helpers::confirm::Confirmer ... Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-11 12:59:26 +10:00
Jiahao XU	c1809d41fa	Refactor: Extract confirm into a new mod ... Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-11 12:59:22 +10:00
Jiahao XU	62be22256b	Refactor: Extract download_and_extract_with_filter ... Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-10 16:37:48 +10:00
Jiahao XU	1d139324c7	Rewrite untar: Takes a filter fn instead of array ... Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-10 16:35:51 +10:00
Jiahao XU	cadf045d0a	Refactor: Abstract away AsyncExtracter by new fn ... `extract_archive_stream` Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-09 22:29:33 +10:00
Jiahao XU	8a812c8d22	Rename AsyncExtracter::write to feed ... Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-09 22:09:46 +10:00
Jiahao XU	945687c281	Rename AsyncFileWriter to AsyncExtracter ... Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-09 22:00:00 +10:00
Jiahao XU	5ba8b07bcb	Rm helpers::extract ... Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-09 14:52:38 +10:00
Jiahao XU	1879a719e4	Rm fn helpers::download ... Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-09 14:47:15 +10:00
Jiahao XU	72983e4113	Use untar in extract_compressed_from_readable ... So that we can specify the files we want to extract to avoid io and save disk usage. Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-09 13:26:47 +10:00
Jiahao XU	784d1f0bf6	Impl new fn helpers::download_and_extract ... Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-09 01:32:38 +10:00
Jiahao XU	c3b5cb11c2	Support for any PkgFmt in AsyncFileWriter ... Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-09 01:20:37 +10:00
Jiahao XU	58c775a648	Rename mod receiver_as_readable to readable_rx ... Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-09 01:02:53 +10:00
Jiahao XU	f211788052	Impl ReadableRx in mod receiver_as_readable ... Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-08 23:04:14 +10:00
Jiahao XU	6bc04340b6	Impl extract_compressed_from_readable and unzip ... in new mod `extracter` Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-08 22:46:20 +10:00
Jiahao XU	894f9b49f9	Simplify AsyncFileWriter::new: Ret Self ... instead of `io::Result<Self>` Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-08 22:29:04 +10:00
Jiahao XU	911c52d8e1	Auto remove file in AsyncFileWriter ... unless done is called. Also moves creation of the dir/file into the blocking thread to avoid blocking. Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-08 22:27:19 +10:00
Jiahao XU	5d70f61317	Refactor: Extract AutoAbortJoinHandle ... Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-08 21:46:32 +10:00
Jiahao XU	358bea5c6d	Refactor: Extract AsyncFileWriter ... Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-08 21:43:09 +10:00
Jiahao XU	e584b99240	Simplify AsyncFileWriter::write by closing rx on err ... Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-08 21:38:05 +10:00
Jiahao XU	d9bcca8b78	Impl AutoAbortJoinHandle::new & make its field private ... plus change all its users to use its new APIs. Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-08 20:53:49 +10:00
Jiahao XU	f41391a53c	Impl Future for AutoAbortJoinHandle ... Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-08 20:51:59 +10:00
Jiahao XU	52210d1a8c	Impl Deref{Mut} for AutoAbortJoinHandle ... Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-08 20:48:31 +10:00
Jiahao XU	d6a372a160	Use AutoAbortJoinHandle in AsyncFileWriter ... to cancel the task on failure. Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-08 20:46:00 +10:00
Jiahao XU	12931fc024	Refactor: Mv AutoAbortJoinHandle into helpers ... Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-08 20:44:20 +10:00
Jiahao XU	6367bfc1e3	Fix infinite block in AsyncFileWriter::write ... Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-08 20:42:22 +10:00
Jiahao XU	c7965ceb4f	Use ScopeGuard to auto remove file on failure ... Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-08 20:23:03 +10:00
Jiahao XU	191fd6e981	Use AsyncFileWriter in helpers::download ... so that writing to file will not block the download. Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-08 20:11:01 +10:00
Jiahao XU	5fdeea86ad	Impl helpers::AsyncFileWriter ... Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>	2022-06-08 20:03:58 +10:00