662 commits

Author	SHA1	Message	Date
Francis Dinh	3aa1d3bf97	backend: update DB_MAX_IMAGE_COMMENT_LENGTH ... This was increased to 2048 characters in 186d693385.	2022-10-17 17:49:48 -04:00
Francis Dinh	04d4dd323f	backend: use time constant in services/chart/index.ts	2022-10-16 18:22:18 -04:00
Francis Dinh	e814fdc7d1	backend: fix lints in services/drive	2022-10-16 18:20:20 -04:00
Francis Dinh	f2f547172e	backend: improve documentation of pin/update functions	2022-10-16 18:06:22 -04:00
Francis Dinh	f17485d8a2	backend: add type annotations to delete.ts	2022-10-16 17:14:30 -04:00
Francis Dinh	70eec26b74	bump versions in all package.json files	2022-10-16 11:46:12 -04:00
Chloe Kudryavtsev	811d5cd0d7	Merge pull request 'deliver Delete activities to all known instances' (#198) from deliver-delete-everyone into main ... Reviewed-on: FoundKeyGang/FoundKey#198	2022-10-16 13:46:23 +00:00
Chloe Kudryavtsev	d762143b89	backend: fixup missing deadTime and incorrect import	2022-10-16 09:32:01 -04:00
Chloe Kudryavtsev	21c1e5c06c	backend: simplify suspended and dead queries ... This should also have better latency due to being a single query. Furthermore, it's no longer a linear scan, since host is indexed. Would be cool to simplify it further to a single query for blocks also... Why exactly are blocks not in the db?	2022-10-16 09:22:05 -04:00
Chloe Kudryavtsev	91a4f38871	backend: add automatic dead instance detection ... It works by having a day-long cache of "when did we last successfully communicate with this instance?" Anything over a specified threshold (1 month) will act as though the instance is suspended - all outgoing jobs are dropped on processing. The day-long cache is in place because the ordering is necessarily a linear scan. Once an instance comes back online, we will detect that is the case as soon as we receive an activity from them (which will update the "last communicated at") field. Potential future TODOs: * Improve the caching system, it's actually pretty inefficient as it is. CacheBox with a call override? * Think of ways to make it not-a-linear-scan, since the instances table can get pretty big. It's around 4500 on toast cafe. ChangeLog: Added	2022-10-16 12:16:04 +00:00
Johann150	756ecbb1f7	fix type error	2022-10-16 04:20:11 +02:00
Johann150	cb0b14ba2d	backend: allow to export only specific emoji	2022-10-12 01:49:53 +02:00
Johann150	7cd11e7afd	fix function name	2022-10-11 21:26:20 +02:00
Johann150	0b8fa2665c	use DISTINCT instead of GROUP BY ... This should have better performance for large recordsets. Ref: FoundKeyGang/FoundKey#198 (comment)	2022-10-11 20:15:59 +02:00
Johann150	421b42d07d	backend: send delete activity to all known instances ... closes FoundKeyGang/FoundKey#190 Changelog: Added	2022-10-11 19:32:26 +02:00
Norm	9a503273fb	Merge pull request 'refactor meta API endpoint' (#196) from refactor/api/meta into main	2022-10-11 17:20:51 +00:00
Norm	20a6140e9a	Merge pull request 'backend: Cleanup prelude directory' (#199) from backend-cleanup-prelude into main ... Reviewed-on: FoundKeyGang/FoundKey#199	2022-10-11 14:47:40 +00:00
Chloe Kudryavtsev	6d58d5ed3b	fixup: muted-renotes review round 1	2022-10-11 10:42:39 +00:00
Chloe Kudryavtsev	897658c188	import publishUserEvent in mute renote APIs	2022-10-11 10:42:39 +00:00
Chloe Kudryavtsev	590a8b98d9	fixup renoteMuting stream filter being overzealous	2022-10-11 10:42:39 +00:00
Chloe Kudryavtsev	dd5100d124	add streaming events for renotemuting and blocking	2022-10-11 10:42:39 +00:00
Chloe Kudryavtsev	3d9df839a5	add down-migration for renote mutes	2022-10-11 10:42:39 +00:00
Hélène	c414f24a2c	feat: per-user renote muting ... Changelog: Added	2022-10-11 10:42:39 +00:00
Michcio	60600729df	backend: Fix import of sanitize-html ... I'm not sure how it managed to work so far, but the function is the default export, using the namespace like a function should not have worked, maybe something under the hood was correcting it back	2022-10-11 10:41:50 +02:00
Francis Dinh	683b0cfa82	backend: remove unused prelude modules ... Much of these modules are no longer used in the backend. They seem to be from before the code was organized in packages.	2022-10-11 01:53:34 -04:00
Francis Dinh	c65559872b	backend: add missing return type annotation in array.ts	2022-10-11 01:51:17 -04:00
Francis Dinh	13a3581817	Merge branch 'refactor/use-null-coalesce-etc' ... Reviewed-on: FoundKeyGang/FoundKey#195	2022-10-10 18:44:19 -04:00
Johann150	808c43377e	refactor: use nullish coalescing & optional chaining ... Changes several places to use the afforementioned constructs in favour of ternary expressions.	2022-10-11 00:39:27 +02:00
Johann150	8920eeb86a	ActivityPub: allow all known shared inboxes to be addressed ... This is oriented on this paragraph from the AP spec: > Additionally, if an object is addressed to the Public special collection, > a server MAY deliver that object to all known sharedInbox endpoints > on the network.	2022-10-11 00:27:43 +02:00
Norm	91c043689b	Merge pull request 'backend: Fix imports from weird paths' (#192) from Michcio/FoundKey-0x7f:extensionless-imports into main ... Reviewed-on: FoundKeyGang/FoundKey#192	2022-10-10 18:58:54 +00:00
Michcio	30faeb73d2	backend: Fix type errors in genId ... I checked on NodeJS locally and `Math.min` was coercing the Dates to numbers, I'm just making it more obvious (to the typechecker as well)	2022-10-10 20:50:04 +02:00
Michcio	dc510c6834	Fix imports from weird paths ... These imports were breaking in TS error checking and VS Code, because imports need to have an extension to be valid, apparently	2022-10-10 20:45:45 +02:00
Michcio	a91bbed34e	Make it impossible to start initializing Vue before DOM exists	2022-10-10 14:22:48 -04:00
Johann150	9022ab9f2a	backend: ignore detail parameter on meta endpoint ... Also allow meta endpoint to be fetched via GET. Changelog: Removed	2022-10-10 17:36:13 +02:00
Francis Dinh	c20352b22e	backend: update THRESHOLD constants to use time constants	2022-10-05 00:54:16 -04:00
Francis Dinh	9084864b34	backend: translate comments in const.ts	2022-10-05 00:52:52 -04:00
Norm	a6d1284423	backend: change Misskey -> FoundKey and use absolute import in index.ts	2022-10-03 20:04:06 +00:00
Norm	8ccc22bb35	Merge pull request 'refactor expiring data and expire signins after 60 days' (#180) from expire-data into main ... Reviewed-on: FoundKeyGang/FoundKey#180	2022-10-03 18:27:13 +00:00
Michcio	ffcb840e06	Fix type in thread muting	2022-10-03 13:24:27 -04:00
Johann150	a7f9e244f3	merge: allow redis family to be specified as a string ... Reviewed-on: FoundKeyGang/FoundKey#165	2022-10-02 18:46:34 +02:00
Johann150	5b7a06675f	refactor expiring data and expire signins after 60 days ... closes FoundKeyGang/FoundKey#176 Changelog: Added	2022-10-02 00:18:07 +02:00
Johann150	36a0e48e49	bacakend: prefer absolute over relative imports ... There are still many places where import paths with `..` are used and maybe should use absolute paths also.	2022-10-01 14:40:30 +02:00
Francis Dinh	8ca544c45d	remove outgoingAddressFamily	2022-09-30 11:05:50 -04:00
Francis Dinh	29164740b9	fix warning message	2022-09-30 11:05:50 -04:00
Francis Dinh	508748ac0d	backend: refactor Redis option loading	2022-09-30 11:05:49 -04:00
Francis Dinh	5a52532c99	allow redis family to be specified as a string ... This makes it consistent with `outgoingAddressFamily`, reducing potential confusion. For compatibility reasons, numbers are still permitted for `redis.family` with the following mapping: - `dual` = `0` - `ipv4` = `4` - `ipv6` = `6` Changelog: Changed	2022-09-30 11:05:49 -04:00
Norm	465b72ab53	Merge pull request 'increase image description limit to 2048 characters' (#174) from bigger-image-description into main ... Reviewed-on: FoundKeyGang/FoundKey#174	2022-09-29 07:28:00 +00:00
Puniko	186d693385	increase image description limit to 2048 characters ... Changelog: Changed	2022-09-24 14:32:07 -04:00
Francis Dinh	f35b856dfa	backend: fix quotes lint in thread-muting/create.ts	2022-09-23 23:02:39 -04:00
Michcio	2bb8642a2c	backend: Fix thread muting queries ... findOne != findOneBy	2022-09-25 15:08:12 +02:00
Norm	9470e12424	Merge pull request 'Revert "Use native shell commands for clean/clean-all"' (#170) from revert-native-clean into main ... Reviewed-on: FoundKeyGang/FoundKey#170	2022-09-23 22:15:29 +00:00
Norm	dba63e4000	Merge pull request 'mute notifications in muted threads' (#119) from mute-notifications into main ... Reviewed-on: FoundKeyGang/FoundKey#119 Changelog: Changed Fixes: #12	2022-09-22 19:52:32 +00:00
Francis Dinh	d9a64d0a22	Revert "Use native shell commands for clean/clean-all" ... This reverts commit 5fb294e7d7. This will allow the clean/clean-all command to work on Windows once again.	2022-09-22 13:48:06 -04:00
Francis Dinh	1b92f580cb	backend: fix imports in queue/types.ts	2022-09-21 13:18:17 -04:00
Johann150	0022a7befb	backend: proper error messages for creating accounts ... Admins will now get proper error messages when they try to create a new user account and an error occurs. Changelog: Fixed	2022-09-21 17:58:42 +02:00
Johann150	cc5a197785	do not create muted notification types in respective threads	2022-09-21 17:54:36 +02:00
Johann150	87411a6ed8	enhance: more descriptive info message	2022-09-21 17:54:36 +02:00
Francis Dinh	7ea052aa25	backend: set moduleResolution to Node16 in tsconfig ... This lets us catch any import errors in the backend as it now lines up with Node's ESM module resolution.	2022-09-21 11:33:57 -04:00
Johann150	321bd24b98	api: handle muting notification types	2022-09-21 15:52:34 +02:00
Johann150	58aa7d36aa	refactor: use noteNotificationTypes	2022-09-21 15:52:34 +02:00
Johann150	35fd970c4a	add column: muted types in thread	2022-09-21 15:52:14 +02:00
Francis Dinh	26449d4944	backend: fix ApiError lints	2022-09-21 13:34:36 +02:00
Francis Dinh	78fd2ee38b	Merge branch 'backend-translate-source-lang' ... Reviewed-on: FoundKeyGang/FoundKey#160	2022-09-20 23:55:21 -04:00
Francis Dinh	8446fa4fca	backend: fixup foundkey ascii logo formatting in base template	2022-09-19 22:53:39 -04:00
Francis Dinh	d5d8affc33	backend: allow for source lang to be overridden in note/translate ... This adds a new optional `sourceLang` parameter to the `notes/translate` endpoint. If not set, the old behaviour is used, else this sets the `source_lang` parameter to the DeepL API call which makes it use the source language specified instead of using autodetection. Changelog: Changed Ref: FoundKeyGang/FoundKey#33	2022-09-19 14:57:20 +00:00
Michcio	7b7d4f5467	Allow files storage path to be set explicitly ... Also added to the example config file - Johann150 Co-authored-by: Johann150 <johann.galle@protonmail.com> Changelog: Added	2022-09-19 11:54:24 +02:00
Johann150	f0b91a62c9	fix HTTP GET parameters in OpenAPI docs ... HTTP GET parameters are not to be specified in the requestBody but in the parameters. This commit fixes that although admittedly it is kind of a bodge and not perfect, but it is a start. Changelog: Fixed	2022-09-19 10:54:23 +02:00
Francis Dinh	4d01ece286	refactor: fix remaining lints in backend daemons	2022-09-14 10:40:04 -04:00
Norm	3cbdac7621	Merge pull request 'chore: Change Misskey references to Foundkey' (#142) ... Reviewed-on: FoundKeyGang/FoundKey#142 Changelog: Changed	2022-09-13 21:20:12 +00:00
Francis Dinh	e507b1b888	backend: localize strings for service integrations ... Currently only the 'connected' and 'disconnected' strings are translated.	2022-09-13 17:18:18 -04:00
Francis Dinh	57f4312a27	chore: Change Misskey references to Foundkey ... Also remove the contributors list from about-foundkey (renamed from about-misskey). Some comments that referenced Misskey were also translated to English. Closes: FoundKeyGang/FoundKey#141	2022-09-13 13:19:36 -04:00
Francis Dinh	2c24f8a9ef	backend: make toHtml tests async ... PRs #84, #134, and #136 changed toHtml to be async, but the test was not updated to reflect that.	2022-09-13 15:20:25 +00:00
Johann150	677c1df597	rename foundkey-js imports to foundkey	2022-09-13 17:17:46 +02:00
Johann150	7ceb96b148	limit id length of all incoming activities	2022-09-12 18:30:53 +02:00
Francis Dinh	1120b6959d	backend: increase requestId max size for GNU Social ... GNU Social's follow request IDs are larger than the 128 character limit of the follow_request.requestId column. This prevents follow requests from GNU Social instances from being handled by Foundkey instances. The solution is to make the requestId column larger. Fixes FoundKeyGang/FoundKey#146	2022-09-12 11:38:55 -04:00
Johann150	515957ee74	render HTML mentions correctly ... Reviewed-on: FoundKeyGang/FoundKey#145 Changelog: Fixed	2022-09-11 21:39:49 +02:00
Francis Dinh	a2fad7ce61	backend: fix mentionedUsers and userInfo queries ... Turns out `getMany` doesn't work with the specific query used, so use `getRawMany` instead. Also fixup the predicate used in userInfo to use the correct field names.	2022-09-11 15:28:35 -04:00
syuilo	4b3cf7834b	server: ensure only own notifications can be marked as read ... Exploiting this before should already have been rather difficult because you would need to know or guess the notification's ID. It is also of relatively low security impact. Changelog: Fixed	2022-09-11 20:52:38 +02:00
Norm	c926b4fbcc	Merge pull request 'backend: Fix appendChildren TypeError' (#136) from fix/backend-to-html-typeerror into main ... Reviewed-on: FoundKeyGang/FoundKey#136 Changelog: Fixed	2022-09-11 18:31:22 +00:00
Francis Dinh	9bcc247421	backend: Fix appendChildren TypeError ... In #134, the mention `MfmNode` handler was made async to allow the mentionedUsers query to be used there. This however changed the return type of that handler to be a `Promise`, causing a `TypeError` in `appendChildren`. This fixes the `TypeError` by making every handler and the `appendChildren` function also async and awaiting on the processed children. This also attempts to fix the types issue with handlers by casting to the newly defined `HandlerFunc` type instead of to `any`.	2022-09-11 14:29:37 -04:00
Francis Dinh	8d5966c0bc	backend: add return types to load.ts functions	2022-09-10 13:52:23 -04:00
Norm	70c12158f7	Merge pull request 'backend: add types and use named exports for daemons' (#127) from fix/backend-daemons-types into main ... Reviewed-on: FoundKeyGang/FoundKey#127	2022-09-10 14:23:30 +00:00
Francis Dinh	9a34e0b2b1	build: update typescript and related packages	2022-09-08 23:00:36 -04:00
Norm	f50b31b847	Merge pull request 'backend: move mentionedUsers query to mention handler' (#134) from fix/backend-toHtml-mentionedUsers into main ... Reviewed-on: FoundKeyGang/FoundKey#134	2022-09-08 22:07:45 +00:00
Francis Dinh	199622b415	add check if ids.length > 0 before executing query	2022-09-08 17:47:23 -04:00
Norm	714ce60980	Merge pull request 'backend: fix types in boot/{master, worker}.ts' (#128) from fix/backend-boot-types into main ... Reviewed-on: FoundKeyGang/FoundKey#128	2022-09-08 21:29:01 +00:00
Francis Dinh	29c7e7e859	backend: fix types in boot/{master, worker}.ts	2022-09-08 17:28:15 -04:00
Johann150	42132963cf	refactor(backend): remove types.ts in favour of foundkey-js	2022-09-08 23:27:25 +02:00
Johann150	aa62c1d7a7	refactor(backend): use foundkey-js constants	2022-09-08 22:27:27 +02:00
Francis Dinh	19e29c3465	backend: move mentionedUsers query to mention handler ... The mentionedUsers query was being run on every post, regardless of whether a mention was in it or not. This resulted in an SQL query ending in `WHERE userId IN ()` which is not allowed in PostgreSQL. Reference: FoundKeyGang/FoundKey#132 Changelog: Fixed	2022-09-08 16:17:35 -04:00
Norm	c33655bc4f	backend: fix table name used in toHtml	2022-09-08 17:14:23 +00:00
Francis Dinh	55d20a72b7	backend: add types and use named exports for daemons	2022-09-08 01:33:47 -04:00
Francis Dinh	4ad53f232a	backend: move @types/pg to devDependencies	2022-09-07 14:20:22 -04:00
Francis Dinh	0e49c726ec	backend: add @types/pg for pg type definitions	2022-09-07 14:19:03 -04:00
Francis Dinh	f21e1afaa4	backend: fix query for mentionedUsers	2022-09-07 13:34:38 -04:00
Johann150	7a981de883	refactor: remove note.mentionedRemoteUsers column ... The column mentionedRemoteUsers on the note table in the database is firstly in the wrong type since it contains JSON data but is typed as text. Secondly it seems redundant, since that data can be acquired by using the note.mentions column to fetch the respective data instead. Co-authored-by: Francis Dinh <normandy@biribiri.dev>	2022-09-07 14:43:04 +02:00
Johann150	3bdbbcadd9	adjust MFM to HTML conversion ... Removed the misc/get-note-html module which was only used in one place. Instead of it, the general MFM to HTML functionality has been improved to take care of the use cases of that module as well. Co-authored-by: Francis Dinh <normandy@biribiri.dev>	2022-09-07 14:42:39 +02:00
Francis Dinh	7b4ebd2715	backend: remove room data from user ... Rooms were remove a while back in upstream Misskey. This removes the associated data left over in the database. Changelog: Removed	2022-09-07 08:30:28 +00:00
Michcio	abef030a24	build: Move resolutions sections to workspace package.json ... Yarn throws a warning on every `yarn install` that the resolutions from respective packages' manifests are ignored.	2022-09-06 23:18:15 +02:00
Francis Dinh	5939c90b84	update eslint plugins	2022-09-06 11:19:34 -04:00