1094 commits

Author	SHA1	Message	Date
Johann150	35e814fab4	fix: don't use psql 13 functions ... The function GEN_RANDOM_UUID was only introduced to built in postgresql in version 13, however, the installation guide specifies that version 12 should be sufficient.	2023-05-27 11:18:06 +02:00
Johann150	9859537b02	BREAKING migrate note favorites to clips ... The following endpoints are removed: - `api/i/favorites` - `api/notes/favorites/create` - `api/notes/favorites/delete` The following endpoints are changed: - `api/notes/state` - `api/users/stats` closes #374 Changelog: Removed	2023-05-26 21:17:04 +02:00
Johann150	aa7171e116	server: remove favorites	2023-05-26 20:59:53 +02:00
Johann150	a3c7571670	add missing comma	2023-05-23 23:56:30 +02:00
Johann150	79acdd7652	fix: properly await file deletion	2023-05-23 22:56:51 +02:00
Johann150	f54fa0ad02	server: remove unnecessary complex loop	2023-05-23 22:56:27 +02:00
Johann150	dfe12cba75	show stack trace from API handler	2023-05-23 22:44:56 +02:00
Johann150	e75123602f	fix reference error from isNull	2023-05-23 22:44:15 +02:00
Johann150	c81368f617	update changelog and version number	2023-05-23 21:59:14 +02:00
Johann150	4307010a9f	fix new occurences of isDeleted	2023-05-23 21:49:34 +02:00
Johann150	e584937b4f	fix: missing paren, type error	2023-05-23 21:49:34 +02:00
Johann150	4312393169	Revert 'Revert "server: fix user deletion race condition"' ... This reverts commit bb3ec8bafe.	2023-05-23 21:49:33 +02:00
Johann150	2fde652b4a	server: fix drive quota for remote users ... This deletes as many files as necessary to ensure the drive quota for remote users is kept. Previously only one file would have been deleted for each file added. Changelog: Fixed Co-authored-by: CGsama <CGsama@outlook.com> Co-authored-by: tamaina <tamaina@hotmail.co.jp>	2023-05-23 21:36:35 +02:00
Johann150	efa8305e0b	BREAKING rename environment variables from MK_... to FK_... ... Changelog: Changed	2023-05-23 19:49:55 +02:00
Johann150	e6a8173378	refactor onlyQueue and onlyServer configuration ... Instead of checking this configuration in the respective component (queue) or not at all (server), the configuration can be checked when starting the respective workers.	2023-05-23 19:49:55 +02:00
Johann150	239a52eb99	add "quiet" log level ... This log level replaces the "MK_QUIET" environment variable to unify the interface in a sensible way. This also removes the "MK_VERBOSE" environment variable which was unused.	2023-05-23 19:49:55 +02:00
Johann150	38c2d86983	add log level environment variable ... To avoid a circular dependency this requires moving the log level definitions. Also to avoid a circular dependency the env.ts file cannot use a logger and instead uses plain `console.log`.	2023-05-23 19:49:55 +02:00
Ignas Kiela	6b9a3259f5	fix: log levels order ... Most important messages are the ones with the highest value This is a fixup for commit c5327f74d4.	2023-05-23 18:12:48 +02:00
Ignas Kiela	296c40c5b4	fix: stop sending pings on every pong ... This resulted in endless ping-pong traffic on the websocket, happening every interval of network latency to the server (e.g. for me, with 40ms latency to my server, it was about every 40ms). On my server this ended up taking about 20% of foundkey's CPU usage. Now, just send pings every 30s, and check if we have received any pong's in last 60 seconds to check that the connection is still alive. Changelog: Fixed	2023-05-23 18:08:08 +02:00
Johann150	fe65cba9be	add "nobody" follower visibility ... Adds a new follower/following visibility that hides followers even from yourself. Changelog: Added	2023-05-20 23:18:57 +02:00
Johann150	ef4055840b	BREAKING server: respect ffVisibility on stats endpoint ... This makes the returned values `localFollowingCount`, `remoteFollowingCount`, `followingCount`, `localFollowersCount`, `remotefollowersCount`, `followersCount` optional on the API endpoint `users/stats`. Changelog: Fixed	2023-05-20 23:18:57 +02:00
Johann150	ded48c96d8	server: use foundkey-js definition of ffVisibilities	2023-05-20 23:18:56 +02:00
Johann150	ed9f2f4900	server: refactor ffVisibility checks into function	2023-05-20 23:18:56 +02:00
Johann150	ff66f48ea2	remove syslog ... closes #19 Changelog: Removed	2023-05-19 23:15:24 +02:00
Johann150	2c3f731ae2	remove more default exports	2023-05-19 23:08:06 +02:00
Johann150	b0d8e15796	fixup: remove some default exports ... This is a fixup for commit 410c519953.	2023-05-19 20:07:26 +02:00
Johann150	410c519953	remove some default exports	2023-05-19 00:32:11 +02:00
Johann150	d6452795b0	translate more comments	2023-05-19 00:21:47 +02:00
Johann150	85a392ee33	logger: remove unused structured data ... The `data` field is not used anywhere in the logger. While it would be possible to send structured data through syslog, it seems unnecessary at present and also the way in which this structured data would have to be provided sounds too cumbersome to implement for no real value.	2023-05-18 22:42:30 +02:00
Johann150	c5327f74d4	refactor to check log levels ... This will eventually allow the log level to be configured. For now, the explicit debug flag does not work.	2023-05-18 21:41:32 +02:00
Johann150	1516ddfc9b	refactor: remove CacheableUser & co ... The CacheableUser, CacheableLocalUser and CacheableRemoteUser are identical types to User, ILocalUser and IRemoteUser so it seems nonsensical to have different types for them.	2023-05-18 13:25:57 +02:00
Johann150	9675ced915	translate japanese comment	2023-05-18 02:08:07 +02:00
Johann150	c53486a47c	try to fix tests	2023-05-15 20:14:51 +02:00
Johann150	386d1bbf74	fix: update meta cache between workers	2023-05-12 19:34:08 +02:00
Johann150	e6c7f4b693	refactor: use switch for receiving IPC messages	2023-05-12 19:18:17 +02:00
Johann150	ac81acfe9d	tests: disable timeouts for server setup	2023-05-08 00:07:40 +02:00
Johann150	5a4e300552	tests: fix visibility tests ... removed a duplicate test and fixed another that i messed up when updating tests for the changed visibility	2023-05-07 23:38:29 +02:00
Johann150	d8c2cc2ef0	tests: translate some japanese to english	2023-05-07 23:37:47 +02:00
Johann150	3d4df807b0	tests: refactor ffVisibility tests ... Using some closures to partly generate the tests to achieve better coverage	2023-05-07 23:35:29 +02:00
Johann150	352851f23f	tests: fix error codes and HTTP statuses	2023-05-07 23:34:34 +02:00
Johann150	eecff514c2	tests: use bearer authentication	2023-05-07 23:33:21 +02:00
Johann150	605a55e1d4	tests: fix Resolver import	2023-05-07 23:32:23 +02:00
Johann150	683584fe8f	update mocha	2023-05-07 23:29:55 +02:00
Johann150	34d55e2dda	server: better matching for MFM mentions ... When rendering the HTML for outgoing activities, the mentions are now matched case insensitive and should also work properly for IDNs. The username is also compared case insensitive. Mentions of local users are also handled properly independed of whether the hostname was given or omitted. The query to get mentions is now also only executed once instead of for each mention individually. Changelog: Fixed	2023-04-28 23:47:48 +02:00
Johann150	9b8438cdfc	server: system accounts cannot be registered ... While refactoring the previous commit, it seemed like the previous authors expected that a system account could be registered somehow and that this would be an error condition. However, as now made explicit with this, it is not possible to register a system account. This means that any account by that name could only ever have been created by the system itself so fetching them should be fine and not an error condition.	2023-04-20 22:10:31 +02:00
Johann150	688deda218	server: dont fail if system user exists ... closes #378 Changelog: Fixed	2023-04-20 22:05:26 +02:00
Johann150	4fbbfff145	activitypub: also check incoming activity host for block	2023-04-16 19:34:15 +02:00
Johann150	5f4aab6d46	translate yet another japanese comment	2023-04-16 19:33:50 +02:00
Johann150	75fd42b070	server: check for valid keyId URL before parse	2023-04-16 19:33:28 +02:00
Johann150	f7bd210316	server: replace Array.find with Array.some	2023-04-16 13:32:36 +02:00
Johann150	ba2b7ef43c	fix including suspended users in getter	2023-04-15 21:10:57 +02:00
Johann150	9a085e9d42	fixup: add missing curly braces ... This is a fixup for commit b14f3e8cdc.	2023-04-15 20:27:42 +02:00
Johann150	b14f3e8cdc	server: properly handle logical deletion ... closes #329	2023-04-15 19:04:07 +02:00
Johann150	71dfd229b0	remove unnecessary code	2023-04-15 18:56:46 +02:00
Johann150	7b8333a21f	server: refactor user getter to throw API error ... Instead of throwing an IdentifiableError which then just always gets converted into an ApiError, the getter can just throw the same ApiError directly. This makes it more convenient to use and thus more endpoints have been refactored to use it to reduce code repetition.	2023-04-15 18:56:42 +02:00
Johann150	ae703cfe4b	server: check that channel id is specified	2023-04-15 18:14:57 +02:00
Johann150	8c47f376dc	server: fix undefined variable in streaming API	2023-04-15 17:52:48 +02:00
Johann150	808ad2a505	server: HTTP signature requires date header ... The default of the library used is to require either of the "date" or "x-date" headers. It does not seem sensible to pass on this default. It may be to fix federation with another software but that software should be considered broken, and it does not seem reasonable to potentially get an outdated signature just to fix federation with some buggy software.	2023-04-13 11:04:35 +02:00
Johann150	340874c252	BREAKING server: remove mediaIds parameter ... This parameter is a duplicate of fileIds and was marked as deprecated before. This removes that parameter and therefore simplifies the API endpoint's schema. Changelog: Removed	2023-04-10 15:07:44 +02:00
Johann150	079a9e29ce	server: replace IRC with issue tracker as preferred feedback ... The IRC channel is not a reliable means of communication for feedback because I don't use it (regularly).	2023-04-01 15:10:12 +02:00
Johann150	1472c21cb6	activitypub: properly handle all scopes for renotes ... This was not implemented because of concerns raised in https://github.com/misskey-dev/misskey/issues/8261 about Mastodon incorrectly interpreting the scope on renotes. However this bug seems to be fixed so it can now be implemented. See also https://github.com/misskey-dev/misskey/pull/10291 Co-authored-by: Kagami Sascha Rosylight <saschanaz@outlook.com>	2023-03-31 07:59:20 +02:00
Johann150	e9f68e65b7	server: fix rate limit for adding reactions ... Adding a reaction may delete a previous reaction to the same note, thus consequently this needs to be in the rate limiting group if this happens. Otherwise the rate limit can be circumvented. Changelog: Fixed	2023-03-28 22:50:04 +02:00
Johann150	48405fba3b	server: fix rate limit error propagation ... Changelog: Fixed	2023-03-28 22:49:58 +02:00
Johann150	1171567db2	server: remove unused API parameters ... Changelog: Removed	2023-03-28 19:36:10 +02:00
Johann150	6179b2e5f0	server: add pagination to file attachment timeline ... As a side effect this also makes the notes appear in chronological order. Changelog: Changed	2023-03-27 20:46:26 +02:00
Johann150	134c3b43e6	implement filtering and sorting in drive ... The `sort` parameter for /api/drive/show is now more unified with other endpoints which use +createdAt for sort instead of +created. closes #109 Changelog: Added	2023-03-26 12:03:43 +02:00
Johann150	68f9e3e0dd	server: change pagination of drive/show endpoint ... This changes the pagination of the drive/show API endpoint to use the offset variant of pagination and allows to specify a sorting. closes #362	2023-03-26 11:05:55 +02:00
Johann150	94d1cf75aa	server: unify drive object types in database ... Minor adjustment: The 'name' columns have the same max length. Major adjustment: Rename both columns to be "parentId" and update all references of this name in the backend. API parameters are not changed, since that would be an unnecessary breaking change.	2023-03-26 11:05:55 +02:00
Johann150	701054b86e	replace NBSP with SP ... How did this get here in the first place?	2023-03-26 10:57:12 +02:00
Johann150	c1f7ad0c14	server: add movedTo to packed user	2023-03-23 21:45:59 +01:00
Johann150	e78069d904	server: implement moveTo property on actors ... Co-authored-by: Mary Strodl <ipadlover8322@gmail.com> Co-authored-by: amybones <amy@spookygirl.boo >	2023-03-23 21:43:50 +01:00
Johann150	72b8489ae7	client: display move notification	2023-03-23 21:10:17 +01:00
Johann150	5ad18c8626	server: add migration for movedTo user/notif	2023-03-23 21:10:16 +01:00
Johann150	910976a55b	server: implement receiving Move activities ... For now only creates notifications.	2023-03-23 21:10:15 +01:00
Johann150	3c2092935c	server: add object hint to resolvePerson	2023-03-23 21:10:14 +01:00
Johann150	3311bd866b	add move notification type	2023-03-23 21:10:08 +01:00
Johann150	c8a07e58f8	server: update summaly ... - updates got (CVE-2022-33987) - now properly preview XHTML pages Changelog: Security	2023-03-23 20:32:31 +01:00
Johann150	f1d7357e75	server: fix undefined variable in getOneApId ... This is a fixup for commit 48fd543d0f. closes #365	2023-03-22 18:30:56 +01:00
Johann150	d3fbe5e382	BREAKING server: refactor streaming API data structures ... Since looking up a channel by ID should be the most often needed use case, the data structure is now more optimized towards this. The code is also simplified by using optional chaining where possible. In this vein, the server will now enforce that channel IDs are unique and not reused. Changelog: Changed	2023-03-19 12:39:57 +01:00
Johann150	7e4148880b	server: improve comments in streaming API	2023-03-19 11:09:56 +01:00
Johann150	ed9b9210a9	server: remove some casting to any	2023-03-19 10:45:57 +01:00
Johann150	742fa37e2b	server: show worker mode in process name ... Changelog: Added	2023-03-19 09:39:33 +01:00
Richard "EpicKitty" Bowey	79a9b04d25	put the migration in its place	2023-03-17 16:16:41 +01:00
Johann150	32beda4344	server: improve error message for invalidating follows ... This error was broken out to be a separate error code and message. Changelog: Changed	2023-03-16 20:42:02 +01:00
Johann150	d6837814d9	Merge branch 'drive-api-combined' ... Reviewed-on: #297	2023-03-13 19:30:24 +01:00
syuilo	1274af05a4	remove unused instance settings	2023-03-12 16:28:07 +01:00
Johann150	6a17dcf4de	server: refactor to group deletion deliveries ... The `quiet` argument has been removed from `deleteNote` (or `deleteNotes` respectively) since it was not used anywhere and it does not seem a good idea to not update statistics in some cases. This should also fix an issue where cascade deletions mean that statistics are not properly updated or streaming clients not properly informed of deletions. This case was seemingly not considered before, even though there was some handling for cascade deleted notes. This is going to improve how cascade deletion impacts the delivery queue, because cascade-deleted notes will now be grouped for delivery. Changelog: Fixed	2023-03-12 12:37:20 +01:00
Johann150	383ea40704	server: add function to deliver multiple activities to a relay	2023-03-11 22:23:42 +01:00
Johann150	e52cf25489	server: use named export for deleteNote	2023-03-11 09:54:46 +01:00
Johann150	1bce487965	activitypub: allow to group elements for delivery	2023-03-11 09:42:14 +01:00
Johann150	78c93c5539	server: clean up activitypub deliver code	2023-03-11 09:42:14 +01:00
Johann150	2164fda2fb	server: do AP sent statistics in request function	2023-03-11 09:42:05 +01:00
Johann150	ee2860e894	improve docs	2023-03-03 23:36:15 +01:00
Johann150	a750c7ad57	server: remove unused avgColor attribute from types	2023-03-03 21:36:21 +01:00
Johann150	5aa5344f2e	docs: fix schema definitions	2023-03-03 21:12:44 +01:00
Johann150	e2063f4ff9	fix: correctly parse quotes	2023-02-24 23:47:50 +01:00
Johann150	57e4971214	Revert "server: fix return of visibilityQuery function" ... This reverts commit 32f4bee5e8. It is the right thing to do in theory, but it doesn't work. I hate typeorm.	2023-02-21 21:16:28 +01:00
Johann150	32f4bee5e8	server: fix return of visibilityQuery function	2023-02-21 21:04:38 +01:00
Johann150	c8731333ba	server: add new deepl languages ... DeepL now also supports Norwegian (Bokmål) and Korean. Ref: https://www.deepl.com/en/blog/welcome-korean-and-norwegian Changelog: Added	2023-02-21 18:24:29 +01:00
Johann150	0a7352eda9	server: add diagnostics for failing visibility	2023-02-20 21:08:58 +01:00