359 Commits

Author	SHA1	Message	Date
Chris Lu	b69cb74c03	read meta logs by timestamp ... pass in event ts when moving logs meta aggregator reads in memory logs only	2020-08-29 17:37:19 -07:00
Chris Lu	ca658a97c5	add signatures to messages to avoid double processing	2020-08-28 23:48:48 -07:00
Chris Lu	b7a654a318	file mime avoid saving application/octet-stream	2020-08-28 19:42:40 -07:00
Chris Lu	2cdad77d82	fix checkin error	2020-08-23 18:30:11 -07:00
Chris Lu	f0e50e7b26	fix test	2020-08-23 16:12:34 -07:00
Chris Lu	aee27ccbe1	multiple fixes ... * adjust isOpen count * move ContinuousDirtyPages lock to filehandle * fix problem with MergeIntoVisibles, avoid reusing slices * let filer delete the garbage	2020-08-23 15:48:02 -07:00
Chris Lu	c19245886c	simpler test	2020-08-23 14:20:27 -07:00
Chris Lu	df816a58fe	add tests	2020-08-23 14:09:25 -07:00
Chris Lu	d60bcbf08a	sorting chunks	2020-08-23 00:00:36 -07:00
Chris Lu	42ddbcc3a2	SQL insert falls back to update ... fix https://github.com/chrislusf/seaweedfs/issues/1429	2020-08-20 07:52:46 -07:00
Chris Lu	c27e18aa6a	read possible old deleted chunks	2020-08-19 00:43:07 -07:00
Chris Lu	3e5339337a	minor	2020-08-18 08:50:14 -07:00
Chris Lu	85001cbec7	properly report io.EOF	2020-08-18 08:18:54 -07:00
Chris Lu	0ca45a5cbc	adjust logs	2020-08-18 00:34:15 -07:00
Chris Lu	cd43738245	fix reading when filling zeros	2020-08-18 00:32:01 -07:00
Chris Lu	ecb3ce46be	adjust error logs	2020-08-18 00:31:42 -07:00
Chris Lu	30fe424469	add one more test case	2020-08-17 22:47:27 -07:00
Chris Lu	1b68ba953b	fix for out of range reads	2020-08-17 22:46:32 -07:00
Chris Lu	56fbd2c211	fix reading	2020-08-17 21:17:32 -07:00
Chris Lu	09e126bae5	refactoring: use interface	2020-08-17 20:20:08 -07:00
Chris Lu	be4d42b8e2	rename	2020-08-17 20:15:53 -07:00
Chris Lu	0625e63648	count 0 as part of the reads	2020-08-17 20:14:40 -07:00
Chris Lu	0be4b6e7f0	logs	2020-08-17 16:05:40 -07:00
Chris Lu	4ceeba9e70	streaming reads	2020-08-16 21:07:46 -07:00
Chris Lu	e72953dff7	logs	2020-08-16 21:06:03 -07:00
Chris Lu	2ba817afac	read randomly written data	2020-08-16 15:16:46 -07:00
Chris Lu	6111b265e7	fix compilation	2020-08-16 01:38:16 -07:00
Chris Lu	4a77f0820a	clean up logs	2020-08-16 01:37:50 -07:00
Chris Lu	8c9e6eaacd	fix tests	2020-08-16 01:35:52 -07:00
Chris Lu	1d9ea30b72	fix ViewFromVisibleIntervals	2020-08-16 00:49:26 -07:00
Chris Lu	aec7f32b02	fix reader_at	2020-08-16 00:49:08 -07:00
Chris Lu	003d48da21	adjust logs	2020-08-15 19:55:28 -07:00
Chris Lu	3e1395b767	adjust log message	2020-08-15 17:06:16 -07:00
Chris Lu	5b43bddf20	proper deletion ordering ... delete central file store first, then delete local cache	2020-08-15 09:33:41 -07:00
Chris Lu	c647deace1	file size support set file length ... use Attr.FileSize and TotalChunkSize to determine file size	2020-08-15 09:32:47 -07:00
Chris Lu	edfa73782f	adjust log level	2020-08-14 00:22:21 -07:00
Chris Lu	f735d579d3	adjust comment	2020-08-12 13:22:19 -07:00
Chris Lu	8824a9755c	remove directory cache	2020-08-12 13:11:04 -07:00
Chris Lu	41007ced77	remove logging	2020-08-06 04:26:29 -07:00
Chris Lu	44057a4de1	clean up chunks in manifest	2020-07-20 22:01:39 -07:00
Chris Lu	0b2e06268b	use merge factor 1000	2020-07-20 18:30:09 -07:00
Chris Lu	d02c0fe0c0	refactoring	2020-07-20 03:34:06 -07:00
Chris Lu	97d97f3528	go code can read and write chunk manifest	2020-07-19 17:59:43 -07:00
Chris Lu	17f2d05cde	filer: ensure logs are persisted	2020-07-14 11:25:50 -07:00
Chris Lu	ddec7b2bb9	go fmt	2020-07-14 07:34:16 -07:00
Chris Lu	4f6096c7f0	add reading from persisted logs for local filer store	2020-07-13 22:55:28 -07:00
Chris Lu	87b5031714	change variable visibility	2020-07-13 08:19:48 -07:00
Chris Lu	7597831cac	filer: leveldb2 supports peers also	2020-07-13 00:05:40 -07:00
Chris Lu	5ba894bb72	leveldb2: support subscribing from peers	2020-07-13 00:05:40 -07:00
Chris Lu	4eecc6abc6	filer: emit metadata notification correctly for batch deletion	2020-07-12 17:32:19 -07:00