963 commits

Author	SHA1	Message	Date
Andreas Nedbal	d3f1ad9a88	chore: remove unused packages	2022-12-06 23:18:27 +01:00
Andreas Nedbal	1aa3898db5	server: remove unused import	2022-12-06 23:12:45 +01:00
Andreas Nedbal	b023741f50	server: remove integrations field from user	2022-12-06 23:00:08 +01:00
Andreas Nedbal	4cc5b734e7	activitypub: remove integration fields from person and nodeinfo	2022-12-06 21:49:19 +01:00
Andreas Nedbal	5d32872999	server: remove integration API routes	2022-12-06 21:48:31 +01:00
Andreas Nedbal	b4b1204f77	server: remove integration-related fields from meta	2022-12-06 21:47:59 +01:00
Norm	c1a51547a9	BREAKING: server: remove wildcard blocking and instead block subdomains (#269) ... Co-authored-by: Francis Dinh <normandy@biribiri.dev> Reviewed-on: #269 Changelog: Changed	2022-12-05 17:55:38 +00:00
Chloe Kudryavtsev	4e74d26e45	backend: fix ratelimit typo ... Changelog: Fixed	2022-12-05 15:49:33 +01:00
Johann150	a421dd401c	activitypub: refactor to always apply recursion limit ... Refactor to remove as many "new Resolver" as possible.	2022-12-04 21:11:44 +01:00
Johann150	c4211761e6	server: refactor resolveSelf to just return the webfinger href ... Since the href seems to be the only attribute that is used, and I didn't want to add a full type definition this was the easier option.	2022-12-04 21:11:43 +01:00
Johann150	03b673165f	server: refactor "authUser" functions into separate file ... They did not really fit into the DbResolver because they may fetch data from remote instances even though DbResolver is only supposed to access the database.	2022-12-04 21:11:35 +01:00
Johann150	de18c8306d	server: fix token-permissions migration ... The table that is affected here was not properly purged of old entries. It only holds data that is needed while a 3rd party authorization is in progress but not finished. The code that typeorm generated for this migration is a bit wonky because it should probably have dropped one column and created another one. But if we clear out all entries it should work regardless and I'm feeling lazy right now. :P	2022-12-04 19:05:02 +01:00
Johann150	11e4a8cb9b	remove erroneous space	2022-12-04 15:34:05 +01:00
Johann150	946e862ecd	server: implement OAuth 2.0 Authorization Code grant ... Changelog: Added Reviewed-on: #205	2022-12-04 14:06:36 +01:00
Johann150	97052b1f61	server: refactor fromHtml attribute handling ... Also try to recognize owncast hashtag links.	2022-12-04 03:43:22 +01:00
Johann150	cda9197700	server: increase nodeinfo caching ... Changelog: Changed	2022-12-04 03:26:50 +01:00
Chloe Kudryavtsev	2dde8273e2	implement separate web workers ... Reviewed-on: #252	2022-12-03 13:33:23 +00:00
Johann150	de927e1f30	server: handle invalid URLs in comparison	2022-12-03 10:38:33 +00:00
Johann150	bdcec2b8a7	server: implement OAuth discovery (RFC 8414)	2022-12-03 10:38:33 +00:00
Johann150	5291f29581	implement OAuth PKCE ... This implements Proof Key for Code Exchange a.k.a. RFC 7636.	2022-12-03 10:38:33 +00:00
Johann150	15b3ab6d13	check redirect URIs	2022-12-03 10:38:33 +00:00
Johann150	79e3c20189	server: allow to grant tokens with more restricted privileges ... This also simplifies API authentication a bit by not having to fetch the App that is related to a token. The restriction of 1 token per app is also lifted. This was not a constraint in the database but it was enforced by the code and kinda wrong schema the auth_session table had.	2022-12-03 10:38:32 +00:00
Johann150	2f2e6a58a4	docs: read scope descriptions from locale strings	2022-12-03 10:38:32 +00:00
Johann150	c65fdebe26	server: add missing auth/deny endpoint ... This endpoint is hinted at in the client, but is not actually defined in the backend. This commit defines it.	2022-12-03 10:38:32 +00:00
Johann150	418c88bb8f	expire AuthSessions after 15 min	2022-12-03 10:38:32 +00:00
Johann150	2b19b34196	update OpenAPI docs to OAuth	2022-12-03 10:38:32 +00:00
Johann150	7db7fdd9e2	add API route for OAuth access token retrieval	2022-12-03 10:38:32 +00:00
Johann150	a13e956af0	make authorization token granting OAuth 2.0 compatible ... This is basically a shim on top of the existing API. Instead of the 3rd party, the web UI generates the authorization session. The data that the API returns is slightly adjusted so that only one API call is necessary instead of two.	2022-12-03 10:38:32 +00:00
Francis Dinh	18cf228f89	server: readd "fetch meta only once in skippedInstances"" ... This reverts commit e446a11bb7. Turns out this wasn't really the source of the referenced issue and someone was able to run with the original commit fine, so adding this back for now.	2022-12-03 05:13:30 -05:00
Francis Dinh	bdf2e14a73	server: fix TypeError in registerOrFetchInstanceDoc ... Changelog: Fixed	2022-12-03 04:01:51 -05:00
Francis Dinh	e446a11bb7	Revert "server: fetch meta only once in skippedInstances" ... This reverts commit 81d63720f2 since it seems to cause a ReferenceError for some reason. Ref: https://toot.site/@jeder/109447151582516733	2022-12-03 02:13:18 -05:00
Johann150	194fff3603	activitypub: hashtags no longer displaying as links ... Some hashtags sent from Mastodon were erroneously displayed as links. This is because Mastodon seems to mangle hashtags containing non-ASCII codepoints (such as e.g. umlauts). This lead to the previous code which depended on the list of hashtags to not recognize a hashtag. Instead, the `rel="tag"` microformat is recognized instead. This makes the `htmlToMfm` wrapper function unnecessary so it was removed. Changelog: Fixed	2022-12-02 19:31:57 +01:00
Johann150	b4080d788d	slight refactoring & translating japanese	2022-12-02 19:00:58 +01:00
Johann150	e49b8d0ef3	server: remove unnecessary apLogger aliases	2022-12-02 18:58:19 +01:00
Johann150	7d3d0f858c	increment versions in package.json	2022-12-02 16:59:47 +01:00
Francis Dinh	81d63720f2	server: fetch meta only once in skippedInstances	2022-12-02 09:26:14 -05:00
Francis Dinh	5e6b51094e	server: fix instance skipping ... This should actually make instance skipping work properly since shouldBlockInstance is now properly awaited on now.	2022-12-02 09:10:56 -05:00
Johann150	9ad37a12f8	server: fix rendering of Follow activity when removing follow ... closes #263 Changelog: Fixed	2022-12-01 21:49:38 +01:00
Norm	e10700a2be	Merge pull request 'server: add wildcard matching to blocked hosts' (#260) from wildcard-block-v2 into main ... Reviewed-on: #260	2022-12-01 20:12:18 +00:00
Johann150	721a327192	fixup: remove unused import	2022-12-01 20:46:46 +01:00
Johann150	936cbf900b	use default argument value ... This unifies the style with the other function in that file and fixes the lint "no-param-reassign".	2022-12-01 20:32:57 +01:00
Francis Dinh	b3e34795c0	require punycode conversion beforehand for admins	2022-12-01 12:07:43 -05:00
Francis Dinh	a35c98bbd5	server: encode non-ascii domains in punycode in matchHost	2022-12-01 11:34:11 -05:00
Francis Dinh	075e251822	server: add wildcard matching to blocked hosts ... This adds in wildcard matching. For instance: - `*.bad.tld` will match: `very.bad.tld` - `bad.*` will match: `bad.something` - `*.bad.*` will match: `very.bad.evil` Changelog: Changed	2022-12-01 11:29:02 -05:00
Derek Schmidt	11a6e706f4	server: Use shared resolver in featured and question accept	2022-12-01 04:40:14 -05:00
Derek Schmidt	d3af00a912	server: Add recursion limit to resolver ... Changelog: Security	2022-12-01 04:40:07 -05:00
Norm	973bd4532b	Merge pull request 'server: always enable push notifications' (#235) from enable-push-notifs into main ... Reviewed-on: #235 Changelog: Changed	2022-11-29 21:51:10 +00:00
Francis Dinh	5733f127ca	backend: update re2 to 1.17.8 ... This should fix Node 19 compatibility. Fixes: #238	2022-11-28 12:02:24 -05:00
Johann150	8130a2a9b1	server: remove deeplIsPro setting ... This setting is unnecessary because DeepL free keys can be detected easily according to <https://www.deepl.com/docs-api/api-access/authentication/>: > DeepL API Free authentication keys can be identified easily by the suffix ":fx" Changelog: Removed	2022-11-27 12:12:56 +01:00
Johann150	9fd23b5dae	server: remove quote urls, 3rd try ... First try was 66a7c62342 but classList is not in parse5 DOM. Second try was 7ee6a09cf2 but forgot the contents of this commit.	2022-11-27 09:30:51 +01:00
Chloe Kudryavtsev	6600f6e52e	fixup: make cluster limit into a per-mode warning rather than error	2022-11-26 13:28:39 +01:00
Johann150	d0c504ec85	server: fix unknown variable in signin endpoint	2022-11-25 19:09:08 +01:00
Johann150	062cba1b3c	server: fix undefined variable for instance actor	2022-11-25 19:05:37 +01:00
Johann150	48a60b03ea	BREAKING: implement separate web workers ... There are now separate web and queue workers. The configuration entry `clusterLimit` has been replaced by `clusterLimits` which allows separate configuration of web and queue workers. Changelog: Changed	2022-11-25 12:56:49 +01:00
Francis Dinh	f817d45210	update eslint and typescript-eslint	2022-11-25 02:07:21 -05:00
Francis Dinh	b67799ad3f	BREAKING: Remove support for Node 16.x and upgrade to TypeScript 4.9 ... Now that Node 18 is the new LTS version of Node, it should be safe to support ES2022 features. The install docs have already been updated to recommend Node 18.x in 41a710854e. This will break support on Node 16.x and earlier. Also update TypeScript to 4.9 which contains various typechecking improvements: https://devblogs.microsoft.com/typescript/announcing-typescript-4-9/ Ref: #238 Changelog: Changed	2022-11-25 02:07:21 -05:00
Johann150	01fa4332c2	server: set vapid keys on initial setup	2022-11-21 22:30:34 +01:00
Johann150	563f3672a9	server: always enable push notifications ... The thing that previously presumably hindered this was that the VAPID keys had to be set up. Previously admins had to do this, but this is a bad idea for multiple reasons: 1) The meaning of "public key" and "private key" was not well documented in the settings. 2) Giving out a private key over the API, even just for admins, sounds like a bad idea. Co-authored-by: Francis Dinh <normandy@biribiri.dev>	2022-11-21 22:00:53 +01:00
Johann150	7ee6a09cf2	fix errors from quote string removal ... The parse5 tree does not have the full DOM methods and attributes.	2022-11-21 19:43:56 +01:00
Johann150	9e2553909e	server: use time constants	2022-11-20 23:15:40 +01:00
Johann150	66a7c62342	activitypub: remove akkoma quote URLs ... Changelog: Fixed	2022-11-20 20:48:15 +00:00
Norm	512351746f	Merge pull request 'Add LibreTranslate support' (#224) from libretranslate into main ... Reviewed-on: #224 Changelog: Added	2022-11-20 16:21:17 +00:00
kabo2468	b7f32be512	server: don't nyaize quoted lines ... Co-authored-by: syuilo <Syuilotan@yahoo.co.jp> Changelog: Changed	2022-11-20 11:15:03 +01:00
Johann150	aefb11959f	fix: translator settings on admin/meta endpoint	2022-11-20 10:37:50 +01:00
Francis Dinh	8cde66b8ac	backend: Add LibreTranslate support	2022-11-19 23:00:33 -05:00
Johann150	7ffe2181a9	server: use host parameter in note search without elasticsearch ... Changelog: Fixed	2022-11-19 17:33:27 +01:00
Johann150	4183c429e6	server: rewrite skipped instances query in raw SQL ... This should hopefully improve performance somewhat. Reviewed-on: #230 Changelog: Changed	2022-11-18 22:02:47 +01:00
Johann150	28aa440bcc	server: correctly await promises when updating server info ... When not awaiting promises, truncating the table and inserting again can sometimes not work due to race conditions.	2022-11-18 20:52:19 +01:00
Norm	71b3b5a60c	backend: implement not forwarding block activities (#212) ... Fixes #211 Commits pulled from https://github.com/misskey-dev/misskey/pull/7799 Changelog: Added Co-authored-by: FloatingGhost <hannah@coffee-and-dreams.uk> Co-authored-by: Johann150 <johann.galle@protonmail.com> Co-authored-by: Francis Dinh <normandy@biribiri.dev> Reviewed-on: #212	2022-11-17 21:24:38 +00:00
Norm	110c645a97	Merge pull request 'backend: fix activitypub.ts lints' (#236) from refactor/activitypub-ts into main ... Reviewed-on: #236	2022-11-17 19:48:08 +00:00
Johann150	ddeb5b25f1	translate comments in chart core	2022-11-17 20:23:17 +01:00
Francis Dinh	c0d5678039	backend: fix lints in various misc modules ... Mostly adding return types and also fixing a type error.	2022-11-16 19:48:16 -05:00
Francis Dinh	629b865789	backend: add return type to getAntennas	2022-11-16 19:44:20 -05:00
Francis Dinh	021d523d5f	backend: fix activitypub.ts lints	2022-11-16 19:38:32 -05:00
Francis Dinh	848b9bcdf1	backend: partially revert repo url change in nodeinfo	2022-11-16 17:58:55 -05:00
Francis Dinh	b18c9b27a6	backend: minor cleanup of nodeinfo.ts ... Copy over the MONTH constant from the client code and the time constants for active{Halfyear,Month}. Also instead of adding and deleting `respository` from the nodeinfo for version 2.0, only add in the repository URL in the 2.1 endpoint.	2022-11-16 17:52:13 -05:00
Johann150	b958be77b6	fixup server: refactor meta caching ... fix: setting meta does not keep cache synced. fix: handle initially empty meta table.	2022-11-16 20:36:22 +01:00
Johann150	9f6be8d557	server: refactor meta caching ... This removes the "caching" that re-fetches the instance meta information from the database every 10 seconds.	2022-11-14 22:12:32 +01:00
Johann150	9d9b2da6cc	fix parameter for cache fetcher	2022-11-13 20:31:24 +01:00
Johann150	d1ec058d5c	server: refactor Cache to hold fetcher as attribute ... Instead of having to pass the fetcher every time you want to fetch something, the fetcher is stored in an attribute of the Cache.	2022-11-13 19:39:30 +01:00
Johann150	131c12a30b	server: refactor prefetchEmojis ... Exiting earlier might slightly improve performance.	2022-11-13 18:24:15 +01:00
Johann150	8d6476af2a	server: remove localUserByIdCache ... The same data is stored in userByIdCache. Whether a user is local or not can easily be determined from the cached object.	2022-11-13 18:03:22 +01:00
Johann150	57299f0df6	server: simplify caching for instance actor	2022-11-13 17:14:33 +01:00
Johann150	b0489abd7f	translate japanese comments	2022-11-13 13:47:22 +01:00
Johann150	a3468491a7	fix import	2022-11-12 18:51:57 +01:00
Johann150	486be564e8	server: improve comments	2022-11-12 17:39:36 +01:00
Johann150	c49f529ccb	server: use DeliverManager for user deletion	2022-11-12 15:23:49 +01:00
Johann150	8979e779da	server: optimise follower inboxes query ... Use the distinct query thingy so we don't have to make the Set work so hard. This is also uniform code with the "everyone" above so should hopefully be easier to understand.	2022-11-12 15:09:50 +01:00
Johann150	f3c38ad5c8	server: only add unique cascade-delete notes	2022-11-11 18:08:57 +01:00
Johann150	899b01a031	remove unnecessary checks ... These checks were made obsolete by commit 6df2f7c55c.	2022-11-11 18:07:49 +01:00
Johann150	a27a29b371	server: redirect browsers to human readable page ... Also added/translated more comments.	2022-11-11 17:54:11 +01:00
Johann150	66a9d27ab1	server: increase user description length to 2048 ... Changelog: Changed	2022-11-11 12:28:57 +01:00
Francis Dinh	d411ea6281	backend: make removeAds migration plain JS	2022-11-10 12:56:39 -05:00
Johann150	5d23aa9e69	translate some comments to english	2022-11-10 00:36:39 +01:00
Johann150	5b61941e4c	server: skip instances that proclaimed themself dead via HTTP 410 ... Changelog: Fixed	2022-11-10 00:23:30 +01:00
Johann150	ca90cedba0	server: reduce dead instance detection to 7 days	2022-11-09 18:47:28 +01:00
Johann150	54075789cd	server: remove content type bodge ... Now that the client should send the proper content type, this should not be necessary any more.	2022-11-08 20:57:38 +01:00
Johann150	609312bb82	server: refactor errors in signin endpoint	2022-11-08 20:57:08 +01:00
Francis Dinh	7939d130aa	backend: update sharp to 0.31.2 ... Changelog: Fixed Fixes: #226	2022-11-08 01:16:55 -05:00
Johann150	489eea0c67	server: improve API validation for creating apps ... Resolves a FIXME comment.	2022-11-05 10:43:34 +01:00
Johann150	6f65326b32	chore: synchronize code and database schema	2022-11-03 21:50:55 +01:00
Norm	e8ecd71f8a	backend: refactor server/nodeinfo.ts (#221) ... This fixes a few type errors like removing `software.respository` in NodeInfo 2.0 and updating `metadata.repositoryUrl` to not use the now removed meta `repositoryUrl` field. Co-authored-by: Francis Dinh <normandy@biribiri.dev> Reviewed-on: #221	2022-11-02 21:42:51 +00:00
Francis Dinh	0db0db9a87	backend: fix types in getRedisFamily	2022-10-31 18:39:05 -04:00
Johann150	6df2f7c55c	server: refactor finding delete-cascaded notes ... Remove the several filter functions in different places by filtering directly in the database. Instead of a QueryBuilder, use the plain find function. Refactor a for loop awaiting several promises individually, use Array.map and await Promise.all to make better use of promises.	2022-10-31 20:57:45 +01:00
Johann150	ac240eb58d	server: translate/add comments	2022-10-31 20:57:18 +01:00
Michcio	d725f93d40	backend: Provide type for signedGet	2022-10-31 10:10:29 +01:00
Michcio	6db9b76f46	Retouch types in server index	2022-10-31 10:10:29 +01:00
Michcio	f50b04b015	Fix type errors in withPackedNote	2022-10-31 10:10:28 +01:00
Michcio	3fe1f7e70e	Deal with withPackedNote(onNote) types in stream channels	2022-10-31 10:10:28 +01:00
Michcio	eff9dbb5ee	Reassure typechecker about token in authenticate	2022-10-31 10:10:28 +01:00
Michcio	fb80fd1fbd	Broaden type in authenticate as undefined is also nullable	2022-10-31 10:10:27 +01:00
Michcio	2a33d0ac83	Fix type import in stream emitter typing	2022-10-31 10:10:27 +01:00
Michcio	fb5f498641	Upgrade bull-board to unify misaligned types in its packages	2022-10-31 10:10:27 +01:00
Michcio	23fbdfdf1f	Fix typos in syslog initialization	2022-10-31 10:10:26 +01:00
Francis Dinh	5b7a7794ab	backend: fix type of IEndpointMeta.errors ... The errors array is supposed to be readonly.	2022-10-31 03:35:47 -04:00
Johann150	bd0c06e2d0	server: fix RefereceError (again...)	2022-10-30 17:46:44 +01:00
Michcio	c282ed7683	Narrow type of isPureRenote ... As side effect of that, a non-null assertion can be removed. Co-authored-by: Johann150 <johann.galle@protonmail.com>	2022-10-30 17:38:56 +01:00
Johann150	240ad1cca6	server: fix ReferenceError ... The super constructor has to be called before accessing this.	2022-10-30 16:22:12 +01:00
Johann150	2aafe8fc9f	server: avoid adding suspended instances to deliver queue ... This should reduce the performance hit when adding large numbers of instances to the deliver queue by making the check for suspended and dead instances a bulk operation. Changelog: Changed Reviewed-on: #215	2022-10-29 22:58:04 +02:00
Johann150	7a64a3858d	fix erroneous quote	2022-10-28 23:49:30 +02:00
Johann150	d0564759a5	server: remove unnecessary argument	2022-10-28 23:36:47 +02:00
Johann150	735b9ab502	fix some lints	2022-10-28 16:57:56 +02:00
Johann150	fb76843c19	adapt OpenAPI documentation generation to new error definitions	2022-10-27 22:44:06 +02:00
Johann150	1dd935dc0c	fix endpoint type definition for errors	2022-10-27 22:44:06 +02:00
Johann150	934ee82b8f	server: refactor ApiError to store error descriptions centrally ... The UUIDs are no longer used for errors and all errors should now have a descriptive message attached to them. Also, all errors should now have the proper HTTP status code for a reply instead of the generic 400 and 500 response codes. Because the errors all have more specific error codes, the "kind" of client or server is also abolished.	2022-10-27 22:43:58 +02:00
Johann150	66d7b69377	server: refactor API handler and returning errors ... This refactors the API handler to not use default exports, be async instead of constructing a promise and modify how errors are returned.	2022-10-26 23:15:31 +02:00
Johann150	c3c7164dfb	fix merge of #213	2022-10-26 22:53:06 +02:00
Johann150	a991740e00	server: improve API definition for messaging/messages/create	2022-10-26 22:21:28 +02:00
Johann150	4dc97d5b65	server: enhance reset-password endpoint ... - Add a rate limit analogous to request-reset-password. See also a0ef32f4f6. - Delete an expired reset request if found. - Return a proper error. - Use time constants. Changelog: Changed	2022-10-26 22:12:38 +02:00
Johann150	384e8c49b7	server: allow to like own gallery posts ... Since you are also allowed to react to your own notes, it seems sensible that you should be allowed to like your own gallery posts. Analogous to commit 4c5aa9e538. Changelog: Changed	2022-10-25 17:13:48 +02:00
Atsuko Karagi	c5e1c42d0a	backend: require authentification for fetch-rss ... Changelog: Changed	2022-10-25 08:56:34 -04:00
Atsuko Karagi	f74395c386	backend: remove unused endpoints ... Changelog: Removed	2022-10-25 08:56:31 -04:00
Atsuko Karagi	b2c483faf5	backend: tweak endpoint permissions ... Changelog: Changed	2022-10-25 08:36:39 -04:00
Atsuko Karagi	5bf1e5ad71	backend: federation information requires auth ... Changelog: Changed	2022-10-25 08:36:37 -04:00
Johann150	a0ef32f4f6	server: properly delete expired password reset requests ... Changelog: Fixed	2022-10-23 23:09:11 +02:00
Francis Dinh	7ec8729d90	backend: fix lint error in remove-note.ts	2022-10-21 17:52:15 -04:00
Francis Dinh	43644494d3	translate remaining comments	2022-10-21 13:33:03 -04:00
Francis Dinh	923c93da12	use await for notes.countBy	2022-10-20 21:22:52 -04:00
Francis Dinh	aa1e4d0fbc	change null assertion ternaries to use optional chaining	2022-10-20 21:22:52 -04:00
Francis Dinh	bfba54524d	backend: fix various type lints in services/note ... `createdAt` in `insertNote` now will default to the current date. Also refactor poll insert: Instead of testing hasPoll, just do a null check on data.poll since it's a more reliable indicator for whether a poll exists (and also tsc won't complain about data.poll being possibly null).	2022-10-20 21:22:24 -04:00
Francis Dinh	d83c1c3851	backend: use named exports for services/note	2022-10-20 21:16:34 -04:00
Francis Dinh	3da7221eec	backend: mark elasticsearch as optional	2022-10-20 21:15:48 -04:00
Johann150	9544cd69d2	fix typo	2022-10-20 21:26:12 +02:00
Johann150	b359b01700	improve docs	2022-10-20 21:22:34 +02:00
Johann150	cfb8723618	fix API definitions	2022-10-20 20:40:48 +02:00
Johann150	ee70ad52fc	server: error when trying to unclip note that is not clipped ... When a note is not added to a clip and an API call tries to remove the note from that clip, the API will now raise an error. Changelog: Changed	2022-10-19 21:54:37 +02:00
Johann150	4c5aa9e538	server: allow to like own pages ... Since you are also allowed to react to your own notes, it seems sensible that you should be allowed to like your own pages. Changelog: Changed	2022-10-19 21:52:43 +02:00
Johann150	4b6c3b2f37	properly await promise	2022-10-19 15:26:37 +02:00
Johann150	fbf7ea07c9	server refactor: centrally load locale ... To reduce code duplication, the locales are loaded in @/misc/i18n.ts directly instead of importing it in each file using it separately.	2022-10-19 12:30:23 +02:00
Johann150	507dede6da	default to english instead of japanese	2022-10-19 09:25:38 +02:00
Norm	7257338077	backend: make max note length configurable (#210) ... Changelog: Added Closes: #208 Co-authored-by: Francis Dinh <normandy@biribiri.dev> Reviewed-on: #210	2022-10-18 17:33:00 +00:00
Francis Dinh	3aa1d3bf97	backend: update DB_MAX_IMAGE_COMMENT_LENGTH ... This was increased to 2048 characters in 186d693385.	2022-10-17 17:49:48 -04:00
Francis Dinh	04d4dd323f	backend: use time constant in services/chart/index.ts	2022-10-16 18:22:18 -04:00
Francis Dinh	e814fdc7d1	backend: fix lints in services/drive	2022-10-16 18:20:20 -04:00
Francis Dinh	f2f547172e	backend: improve documentation of pin/update functions	2022-10-16 18:06:22 -04:00
Francis Dinh	f17485d8a2	backend: add type annotations to delete.ts	2022-10-16 17:14:30 -04:00
Francis Dinh	70eec26b74	bump versions in all package.json files	2022-10-16 11:46:12 -04:00
Chloe Kudryavtsev	811d5cd0d7	Merge pull request 'deliver Delete activities to all known instances' (#198) from deliver-delete-everyone into main ... Reviewed-on: #198	2022-10-16 13:46:23 +00:00
Chloe Kudryavtsev	d762143b89	backend: fixup missing deadTime and incorrect import	2022-10-16 09:32:01 -04:00
Chloe Kudryavtsev	21c1e5c06c	backend: simplify suspended and dead queries ... This should also have better latency due to being a single query. Furthermore, it's no longer a linear scan, since host is indexed. Would be cool to simplify it further to a single query for blocks also... Why exactly are blocks not in the db?	2022-10-16 09:22:05 -04:00
Chloe Kudryavtsev	91a4f38871	backend: add automatic dead instance detection ... It works by having a day-long cache of "when did we last successfully communicate with this instance?" Anything over a specified threshold (1 month) will act as though the instance is suspended - all outgoing jobs are dropped on processing. The day-long cache is in place because the ordering is necessarily a linear scan. Once an instance comes back online, we will detect that is the case as soon as we receive an activity from them (which will update the "last communicated at") field. Potential future TODOs: * Improve the caching system, it's actually pretty inefficient as it is. CacheBox with a call override? * Think of ways to make it not-a-linear-scan, since the instances table can get pretty big. It's around 4500 on toast cafe. ChangeLog: Added	2022-10-16 12:16:04 +00:00
Johann150	756ecbb1f7	fix type error	2022-10-16 04:20:11 +02:00
Johann150	cb0b14ba2d	backend: allow to export only specific emoji	2022-10-12 01:49:53 +02:00
Johann150	7cd11e7afd	fix function name	2022-10-11 21:26:20 +02:00
Johann150	0b8fa2665c	use DISTINCT instead of GROUP BY ... This should have better performance for large recordsets. Ref: #198 (comment)	2022-10-11 20:15:59 +02:00
Johann150	421b42d07d	backend: send delete activity to all known instances ... closes #190 Changelog: Added	2022-10-11 19:32:26 +02:00
Norm	9a503273fb	Merge pull request 'refactor meta API endpoint' (#196) from refactor/api/meta into main	2022-10-11 17:20:51 +00:00
Norm	20a6140e9a	Merge pull request 'backend: Cleanup prelude directory' (#199) from backend-cleanup-prelude into main ... Reviewed-on: #199	2022-10-11 14:47:40 +00:00
Chloe Kudryavtsev	6d58d5ed3b	fixup: muted-renotes review round 1	2022-10-11 10:42:39 +00:00
Chloe Kudryavtsev	897658c188	import publishUserEvent in mute renote APIs	2022-10-11 10:42:39 +00:00
Chloe Kudryavtsev	590a8b98d9	fixup renoteMuting stream filter being overzealous	2022-10-11 10:42:39 +00:00
Chloe Kudryavtsev	dd5100d124	add streaming events for renotemuting and blocking	2022-10-11 10:42:39 +00:00
Chloe Kudryavtsev	3d9df839a5	add down-migration for renote mutes	2022-10-11 10:42:39 +00:00
Hélène	c414f24a2c	feat: per-user renote muting ... Changelog: Added	2022-10-11 10:42:39 +00:00
Michcio	60600729df	backend: Fix import of sanitize-html ... I'm not sure how it managed to work so far, but the function is the default export, using the namespace like a function should not have worked, maybe something under the hood was correcting it back	2022-10-11 10:41:50 +02:00
Francis Dinh	683b0cfa82	backend: remove unused prelude modules ... Much of these modules are no longer used in the backend. They seem to be from before the code was organized in packages.	2022-10-11 01:53:34 -04:00
Francis Dinh	c65559872b	backend: add missing return type annotation in array.ts	2022-10-11 01:51:17 -04:00
Francis Dinh	13a3581817	Merge branch 'refactor/use-null-coalesce-etc' ... Reviewed-on: #195	2022-10-10 18:44:19 -04:00
Johann150	808c43377e	refactor: use nullish coalescing & optional chaining ... Changes several places to use the afforementioned constructs in favour of ternary expressions.	2022-10-11 00:39:27 +02:00
Johann150	8920eeb86a	ActivityPub: allow all known shared inboxes to be addressed ... This is oriented on this paragraph from the AP spec: > Additionally, if an object is addressed to the Public special collection, > a server MAY deliver that object to all known sharedInbox endpoints > on the network.	2022-10-11 00:27:43 +02:00
Norm	91c043689b	Merge pull request 'backend: Fix imports from weird paths' (#192) from Michcio/FoundKey-0x7f:extensionless-imports into main ... Reviewed-on: #192	2022-10-10 18:58:54 +00:00
Michcio	30faeb73d2	backend: Fix type errors in genId ... I checked on NodeJS locally and `Math.min` was coercing the Dates to numbers, I'm just making it more obvious (to the typechecker as well)	2022-10-10 20:50:04 +02:00
Michcio	dc510c6834	Fix imports from weird paths ... These imports were breaking in TS error checking and VS Code, because imports need to have an extension to be valid, apparently	2022-10-10 20:45:45 +02:00
Michcio	a91bbed34e	Make it impossible to start initializing Vue before DOM exists	2022-10-10 14:22:48 -04:00
Johann150	9022ab9f2a	backend: ignore detail parameter on meta endpoint ... Also allow meta endpoint to be fetched via GET. Changelog: Removed	2022-10-10 17:36:13 +02:00
Francis Dinh	c20352b22e	backend: update THRESHOLD constants to use time constants	2022-10-05 00:54:16 -04:00
Francis Dinh	9084864b34	backend: translate comments in const.ts	2022-10-05 00:52:52 -04:00
Norm	a6d1284423	backend: change Misskey -> FoundKey and use absolute import in index.ts	2022-10-03 20:04:06 +00:00
Norm	8ccc22bb35	Merge pull request 'refactor expiring data and expire signins after 60 days' (#180) from expire-data into main ... Reviewed-on: #180	2022-10-03 18:27:13 +00:00
Michcio	ffcb840e06	Fix type in thread muting	2022-10-03 13:24:27 -04:00
Johann150	a7f9e244f3	merge: allow redis family to be specified as a string ... Reviewed-on: #165	2022-10-02 18:46:34 +02:00
Johann150	5b7a06675f	refactor expiring data and expire signins after 60 days ... closes #176 Changelog: Added	2022-10-02 00:18:07 +02:00
Johann150	36a0e48e49	bacakend: prefer absolute over relative imports ... There are still many places where import paths with `..` are used and maybe should use absolute paths also.	2022-10-01 14:40:30 +02:00
Francis Dinh	8ca544c45d	remove outgoingAddressFamily	2022-09-30 11:05:50 -04:00
Francis Dinh	29164740b9	fix warning message	2022-09-30 11:05:50 -04:00
Francis Dinh	508748ac0d	backend: refactor Redis option loading	2022-09-30 11:05:49 -04:00
Francis Dinh	5a52532c99	allow redis family to be specified as a string ... This makes it consistent with `outgoingAddressFamily`, reducing potential confusion. For compatibility reasons, numbers are still permitted for `redis.family` with the following mapping: - `dual` = `0` - `ipv4` = `4` - `ipv6` = `6` Changelog: Changed	2022-09-30 11:05:49 -04:00
Norm	465b72ab53	Merge pull request 'increase image description limit to 2048 characters' (#174) from bigger-image-description into main ... Reviewed-on: #174	2022-09-29 07:28:00 +00:00
Puniko	186d693385	increase image description limit to 2048 characters ... Changelog: Changed	2022-09-24 14:32:07 -04:00
Francis Dinh	f35b856dfa	backend: fix quotes lint in thread-muting/create.ts	2022-09-23 23:02:39 -04:00
Michcio	2bb8642a2c	backend: Fix thread muting queries ... findOne != findOneBy	2022-09-25 15:08:12 +02:00
Norm	9470e12424	Merge pull request 'Revert "Use native shell commands for clean/clean-all"' (#170) from revert-native-clean into main ... Reviewed-on: #170	2022-09-23 22:15:29 +00:00
Norm	dba63e4000	Merge pull request 'mute notifications in muted threads' (#119) from mute-notifications into main ... Reviewed-on: #119 Changelog: Changed Fixes: #12	2022-09-22 19:52:32 +00:00
Francis Dinh	d9a64d0a22	Revert "Use native shell commands for clean/clean-all" ... This reverts commit 5fb294e7d7. This will allow the clean/clean-all command to work on Windows once again.	2022-09-22 13:48:06 -04:00
Francis Dinh	1b92f580cb	backend: fix imports in queue/types.ts	2022-09-21 13:18:17 -04:00
Johann150	0022a7befb	backend: proper error messages for creating accounts ... Admins will now get proper error messages when they try to create a new user account and an error occurs. Changelog: Fixed	2022-09-21 17:58:42 +02:00
Johann150	cc5a197785	do not create muted notification types in respective threads	2022-09-21 17:54:36 +02:00
Johann150	87411a6ed8	enhance: more descriptive info message	2022-09-21 17:54:36 +02:00
Francis Dinh	7ea052aa25	backend: set moduleResolution to Node16 in tsconfig ... This lets us catch any import errors in the backend as it now lines up with Node's ESM module resolution.	2022-09-21 11:33:57 -04:00
Johann150	321bd24b98	api: handle muting notification types	2022-09-21 15:52:34 +02:00
Johann150	58aa7d36aa	refactor: use noteNotificationTypes	2022-09-21 15:52:34 +02:00
Johann150	35fd970c4a	add column: muted types in thread	2022-09-21 15:52:14 +02:00
Francis Dinh	26449d4944	backend: fix ApiError lints	2022-09-21 13:34:36 +02:00
Francis Dinh	78fd2ee38b	Merge branch 'backend-translate-source-lang' ... Reviewed-on: #160	2022-09-20 23:55:21 -04:00
Francis Dinh	8446fa4fca	backend: fixup foundkey ascii logo formatting in base template	2022-09-19 22:53:39 -04:00
Francis Dinh	d5d8affc33	backend: allow for source lang to be overridden in note/translate ... This adds a new optional `sourceLang` parameter to the `notes/translate` endpoint. If not set, the old behaviour is used, else this sets the `source_lang` parameter to the DeepL API call which makes it use the source language specified instead of using autodetection. Changelog: Changed Ref: #33	2022-09-19 14:57:20 +00:00
Michcio	7b7d4f5467	Allow files storage path to be set explicitly ... Also added to the example config file - Johann150 Co-authored-by: Johann150 <johann.galle@protonmail.com> Changelog: Added	2022-09-19 11:54:24 +02:00
Johann150	f0b91a62c9	fix HTTP GET parameters in OpenAPI docs ... HTTP GET parameters are not to be specified in the requestBody but in the parameters. This commit fixes that although admittedly it is kind of a bodge and not perfect, but it is a start. Changelog: Fixed	2022-09-19 10:54:23 +02:00
Francis Dinh	4d01ece286	refactor: fix remaining lints in backend daemons	2022-09-14 10:40:04 -04:00
Norm	3cbdac7621	Merge pull request 'chore: Change Misskey references to Foundkey' (#142) ... Reviewed-on: #142 Changelog: Changed	2022-09-13 21:20:12 +00:00
Francis Dinh	e507b1b888	backend: localize strings for service integrations ... Currently only the 'connected' and 'disconnected' strings are translated.	2022-09-13 17:18:18 -04:00
Francis Dinh	57f4312a27	chore: Change Misskey references to Foundkey ... Also remove the contributors list from about-foundkey (renamed from about-misskey). Some comments that referenced Misskey were also translated to English. Closes: #141	2022-09-13 13:19:36 -04:00
Francis Dinh	2c24f8a9ef	backend: make toHtml tests async ... PRs #84, #134, and #136 changed toHtml to be async, but the test was not updated to reflect that.	2022-09-13 15:20:25 +00:00
Johann150	677c1df597	rename foundkey-js imports to foundkey	2022-09-13 17:17:46 +02:00
Johann150	7ceb96b148	limit id length of all incoming activities	2022-09-12 18:30:53 +02:00
Francis Dinh	1120b6959d	backend: increase requestId max size for GNU Social ... GNU Social's follow request IDs are larger than the 128 character limit of the follow_request.requestId column. This prevents follow requests from GNU Social instances from being handled by Foundkey instances. The solution is to make the requestId column larger. Fixes #146	2022-09-12 11:38:55 -04:00
Johann150	515957ee74	render HTML mentions correctly ... Reviewed-on: #145 Changelog: Fixed	2022-09-11 21:39:49 +02:00
Francis Dinh	a2fad7ce61	backend: fix mentionedUsers and userInfo queries ... Turns out `getMany` doesn't work with the specific query used, so use `getRawMany` instead. Also fixup the predicate used in userInfo to use the correct field names.	2022-09-11 15:28:35 -04:00
syuilo	4b3cf7834b	server: ensure only own notifications can be marked as read ... Exploiting this before should already have been rather difficult because you would need to know or guess the notification's ID. It is also of relatively low security impact. Changelog: Fixed	2022-09-11 20:52:38 +02:00
Norm	c926b4fbcc	Merge pull request 'backend: Fix appendChildren TypeError' (#136) from fix/backend-to-html-typeerror into main ... Reviewed-on: #136 Changelog: Fixed	2022-09-11 18:31:22 +00:00
Francis Dinh	9bcc247421	backend: Fix appendChildren TypeError ... In #134, the mention `MfmNode` handler was made async to allow the mentionedUsers query to be used there. This however changed the return type of that handler to be a `Promise`, causing a `TypeError` in `appendChildren`. This fixes the `TypeError` by making every handler and the `appendChildren` function also async and awaiting on the processed children. This also attempts to fix the types issue with handlers by casting to the newly defined `HandlerFunc` type instead of to `any`.	2022-09-11 14:29:37 -04:00
Francis Dinh	8d5966c0bc	backend: add return types to load.ts functions	2022-09-10 13:52:23 -04:00
Norm	70c12158f7	Merge pull request 'backend: add types and use named exports for daemons' (#127) from fix/backend-daemons-types into main ... Reviewed-on: #127	2022-09-10 14:23:30 +00:00
Francis Dinh	9a34e0b2b1	build: update typescript and related packages	2022-09-08 23:00:36 -04:00
Norm	f50b31b847	Merge pull request 'backend: move mentionedUsers query to mention handler' (#134) from fix/backend-toHtml-mentionedUsers into main ... Reviewed-on: #134	2022-09-08 22:07:45 +00:00
Francis Dinh	199622b415	add check if ids.length > 0 before executing query	2022-09-08 17:47:23 -04:00
Norm	714ce60980	Merge pull request 'backend: fix types in boot/{master, worker}.ts' (#128) from fix/backend-boot-types into main ... Reviewed-on: #128	2022-09-08 21:29:01 +00:00
Francis Dinh	29c7e7e859	backend: fix types in boot/{master, worker}.ts	2022-09-08 17:28:15 -04:00
Johann150	42132963cf	refactor(backend): remove types.ts in favour of foundkey-js	2022-09-08 23:27:25 +02:00
Johann150	aa62c1d7a7	refactor(backend): use foundkey-js constants	2022-09-08 22:27:27 +02:00
Francis Dinh	19e29c3465	backend: move mentionedUsers query to mention handler ... The mentionedUsers query was being run on every post, regardless of whether a mention was in it or not. This resulted in an SQL query ending in `WHERE userId IN ()` which is not allowed in PostgreSQL. Reference: #132 Changelog: Fixed	2022-09-08 16:17:35 -04:00
Norm	c33655bc4f	backend: fix table name used in toHtml	2022-09-08 17:14:23 +00:00
Francis Dinh	55d20a72b7	backend: add types and use named exports for daemons	2022-09-08 01:33:47 -04:00
Francis Dinh	4ad53f232a	backend: move @types/pg to devDependencies	2022-09-07 14:20:22 -04:00
Francis Dinh	0e49c726ec	backend: add @types/pg for pg type definitions	2022-09-07 14:19:03 -04:00
Francis Dinh	f21e1afaa4	backend: fix query for mentionedUsers	2022-09-07 13:34:38 -04:00
Johann150	7a981de883	refactor: remove note.mentionedRemoteUsers column ... The column mentionedRemoteUsers on the note table in the database is firstly in the wrong type since it contains JSON data but is typed as text. Secondly it seems redundant, since that data can be acquired by using the note.mentions column to fetch the respective data instead. Co-authored-by: Francis Dinh <normandy@biribiri.dev>	2022-09-07 14:43:04 +02:00
Johann150	3bdbbcadd9	adjust MFM to HTML conversion ... Removed the misc/get-note-html module which was only used in one place. Instead of it, the general MFM to HTML functionality has been improved to take care of the use cases of that module as well. Co-authored-by: Francis Dinh <normandy@biribiri.dev>	2022-09-07 14:42:39 +02:00
Francis Dinh	7b4ebd2715	backend: remove room data from user ... Rooms were remove a while back in upstream Misskey. This removes the associated data left over in the database. Changelog: Removed	2022-09-07 08:30:28 +00:00
Michcio	abef030a24	build: Move resolutions sections to workspace package.json ... Yarn throws a warning on every `yarn install` that the resolutions from respective packages' manifests are ignored.	2022-09-06 23:18:15 +02:00