800 commits

Author	SHA1	Message	Date
Johann150	aefb11959f	fix: translator settings on admin/meta endpoint	2022-11-20 10:37:50 +01:00
Francis Dinh	8cde66b8ac	backend: Add LibreTranslate support	2022-11-19 23:00:33 -05:00
Johann150	7ffe2181a9	server: use host parameter in note search without elasticsearch ... Changelog: Fixed	2022-11-19 17:33:27 +01:00
Johann150	4183c429e6	server: rewrite skipped instances query in raw SQL ... This should hopefully improve performance somewhat. Reviewed-on: FoundKeyGang/FoundKey#230 Changelog: Changed	2022-11-18 22:02:47 +01:00
Johann150	28aa440bcc	server: correctly await promises when updating server info ... When not awaiting promises, truncating the table and inserting again can sometimes not work due to race conditions.	2022-11-18 20:52:19 +01:00
Norm	71b3b5a60c	backend: implement not forwarding block activities (#212) ... Fixes FoundKeyGang/FoundKey#211 Commits pulled from https://github.com/misskey-dev/misskey/pull/7799 Changelog: Added Co-authored-by: FloatingGhost <hannah@coffee-and-dreams.uk> Co-authored-by: Johann150 <johann.galle@protonmail.com> Co-authored-by: Francis Dinh <normandy@biribiri.dev> Reviewed-on: FoundKeyGang/FoundKey#212	2022-11-17 21:24:38 +00:00
Norm	110c645a97	Merge pull request 'backend: fix activitypub.ts lints' (#236) from refactor/activitypub-ts into main ... Reviewed-on: FoundKeyGang/FoundKey#236	2022-11-17 19:48:08 +00:00
Johann150	ddeb5b25f1	translate comments in chart core	2022-11-17 20:23:17 +01:00
Francis Dinh	c0d5678039	backend: fix lints in various misc modules ... Mostly adding return types and also fixing a type error.	2022-11-16 19:48:16 -05:00
Francis Dinh	629b865789	backend: add return type to getAntennas	2022-11-16 19:44:20 -05:00
Francis Dinh	021d523d5f	backend: fix activitypub.ts lints	2022-11-16 19:38:32 -05:00
Francis Dinh	848b9bcdf1	backend: partially revert repo url change in nodeinfo	2022-11-16 17:58:55 -05:00
Francis Dinh	b18c9b27a6	backend: minor cleanup of nodeinfo.ts ... Copy over the MONTH constant from the client code and the time constants for active{Halfyear,Month}. Also instead of adding and deleting `respository` from the nodeinfo for version 2.0, only add in the repository URL in the 2.1 endpoint.	2022-11-16 17:52:13 -05:00
Johann150	b958be77b6	fixup server: refactor meta caching ... fix: setting meta does not keep cache synced. fix: handle initially empty meta table.	2022-11-16 20:36:22 +01:00
Johann150	9f6be8d557	server: refactor meta caching ... This removes the "caching" that re-fetches the instance meta information from the database every 10 seconds.	2022-11-14 22:12:32 +01:00
Johann150	9d9b2da6cc	fix parameter for cache fetcher	2022-11-13 20:31:24 +01:00
Johann150	d1ec058d5c	server: refactor Cache to hold fetcher as attribute ... Instead of having to pass the fetcher every time you want to fetch something, the fetcher is stored in an attribute of the Cache.	2022-11-13 19:39:30 +01:00
Johann150	131c12a30b	server: refactor prefetchEmojis ... Exiting earlier might slightly improve performance.	2022-11-13 18:24:15 +01:00
Johann150	8d6476af2a	server: remove localUserByIdCache ... The same data is stored in userByIdCache. Whether a user is local or not can easily be determined from the cached object.	2022-11-13 18:03:22 +01:00
Johann150	57299f0df6	server: simplify caching for instance actor	2022-11-13 17:14:33 +01:00
Johann150	b0489abd7f	translate japanese comments	2022-11-13 13:47:22 +01:00
Johann150	a3468491a7	fix import	2022-11-12 18:51:57 +01:00
Johann150	486be564e8	server: improve comments	2022-11-12 17:39:36 +01:00
Johann150	c49f529ccb	server: use DeliverManager for user deletion	2022-11-12 15:23:49 +01:00
Johann150	8979e779da	server: optimise follower inboxes query ... Use the distinct query thingy so we don't have to make the Set work so hard. This is also uniform code with the "everyone" above so should hopefully be easier to understand.	2022-11-12 15:09:50 +01:00
Johann150	f3c38ad5c8	server: only add unique cascade-delete notes	2022-11-11 18:08:57 +01:00
Johann150	899b01a031	remove unnecessary checks ... These checks were made obsolete by commit 6df2f7c55c.	2022-11-11 18:07:49 +01:00
Johann150	a27a29b371	server: redirect browsers to human readable page ... Also added/translated more comments.	2022-11-11 17:54:11 +01:00
Johann150	66a9d27ab1	server: increase user description length to 2048 ... Changelog: Changed	2022-11-11 12:28:57 +01:00
Francis Dinh	d411ea6281	backend: make removeAds migration plain JS	2022-11-10 12:56:39 -05:00
Johann150	5d23aa9e69	translate some comments to english	2022-11-10 00:36:39 +01:00
Johann150	5b61941e4c	server: skip instances that proclaimed themself dead via HTTP 410 ... Changelog: Fixed	2022-11-10 00:23:30 +01:00
Johann150	ca90cedba0	server: reduce dead instance detection to 7 days	2022-11-09 18:47:28 +01:00
Johann150	54075789cd	server: remove content type bodge ... Now that the client should send the proper content type, this should not be necessary any more.	2022-11-08 20:57:38 +01:00
Johann150	609312bb82	server: refactor errors in signin endpoint	2022-11-08 20:57:08 +01:00
Francis Dinh	7939d130aa	backend: update sharp to 0.31.2 ... Changelog: Fixed Fixes: FoundKeyGang/FoundKey#226	2022-11-08 01:16:55 -05:00
Johann150	489eea0c67	server: improve API validation for creating apps ... Resolves a FIXME comment.	2022-11-05 10:43:34 +01:00
Johann150	6f65326b32	chore: synchronize code and database schema	2022-11-03 21:50:55 +01:00
Norm	e8ecd71f8a	backend: refactor server/nodeinfo.ts (#221) ... This fixes a few type errors like removing `software.respository` in NodeInfo 2.0 and updating `metadata.repositoryUrl` to not use the now removed meta `repositoryUrl` field. Co-authored-by: Francis Dinh <normandy@biribiri.dev> Reviewed-on: FoundKeyGang/FoundKey#221	2022-11-02 21:42:51 +00:00
Francis Dinh	0db0db9a87	backend: fix types in getRedisFamily	2022-10-31 18:39:05 -04:00
Johann150	6df2f7c55c	server: refactor finding delete-cascaded notes ... Remove the several filter functions in different places by filtering directly in the database. Instead of a QueryBuilder, use the plain find function. Refactor a for loop awaiting several promises individually, use Array.map and await Promise.all to make better use of promises.	2022-10-31 20:57:45 +01:00
Johann150	ac240eb58d	server: translate/add comments	2022-10-31 20:57:18 +01:00
Michcio	d725f93d40	backend: Provide type for signedGet	2022-10-31 10:10:29 +01:00
Michcio	6db9b76f46	Retouch types in server index	2022-10-31 10:10:29 +01:00
Michcio	f50b04b015	Fix type errors in withPackedNote	2022-10-31 10:10:28 +01:00
Michcio	3fe1f7e70e	Deal with withPackedNote(onNote) types in stream channels	2022-10-31 10:10:28 +01:00
Michcio	eff9dbb5ee	Reassure typechecker about token in authenticate	2022-10-31 10:10:28 +01:00
Michcio	fb80fd1fbd	Broaden type in authenticate as undefined is also nullable	2022-10-31 10:10:27 +01:00
Michcio	2a33d0ac83	Fix type import in stream emitter typing	2022-10-31 10:10:27 +01:00
Michcio	fb5f498641	Upgrade bull-board to unify misaligned types in its packages	2022-10-31 10:10:27 +01:00
Michcio	23fbdfdf1f	Fix typos in syslog initialization	2022-10-31 10:10:26 +01:00
Francis Dinh	5b7a7794ab	backend: fix type of IEndpointMeta.errors ... The errors array is supposed to be readonly.	2022-10-31 03:35:47 -04:00
Johann150	bd0c06e2d0	server: fix RefereceError (again...)	2022-10-30 17:46:44 +01:00
Michcio	c282ed7683	Narrow type of isPureRenote ... As side effect of that, a non-null assertion can be removed. Co-authored-by: Johann150 <johann.galle@protonmail.com>	2022-10-30 17:38:56 +01:00
Johann150	240ad1cca6	server: fix ReferenceError ... The super constructor has to be called before accessing this.	2022-10-30 16:22:12 +01:00
Johann150	2aafe8fc9f	server: avoid adding suspended instances to deliver queue ... This should reduce the performance hit when adding large numbers of instances to the deliver queue by making the check for suspended and dead instances a bulk operation. Changelog: Changed Reviewed-on: FoundKeyGang/FoundKey#215	2022-10-29 22:58:04 +02:00
Johann150	7a64a3858d	fix erroneous quote	2022-10-28 23:49:30 +02:00
Johann150	d0564759a5	server: remove unnecessary argument	2022-10-28 23:36:47 +02:00
Johann150	735b9ab502	fix some lints	2022-10-28 16:57:56 +02:00
Johann150	fb76843c19	adapt OpenAPI documentation generation to new error definitions	2022-10-27 22:44:06 +02:00
Johann150	1dd935dc0c	fix endpoint type definition for errors	2022-10-27 22:44:06 +02:00
Johann150	934ee82b8f	server: refactor ApiError to store error descriptions centrally ... The UUIDs are no longer used for errors and all errors should now have a descriptive message attached to them. Also, all errors should now have the proper HTTP status code for a reply instead of the generic 400 and 500 response codes. Because the errors all have more specific error codes, the "kind" of client or server is also abolished.	2022-10-27 22:43:58 +02:00
Johann150	66d7b69377	server: refactor API handler and returning errors ... This refactors the API handler to not use default exports, be async instead of constructing a promise and modify how errors are returned.	2022-10-26 23:15:31 +02:00
Johann150	c3c7164dfb	fix merge of #213	2022-10-26 22:53:06 +02:00
Johann150	a991740e00	server: improve API definition for messaging/messages/create	2022-10-26 22:21:28 +02:00
Johann150	4dc97d5b65	server: enhance reset-password endpoint ... - Add a rate limit analogous to request-reset-password. See also a0ef32f4f6. - Delete an expired reset request if found. - Return a proper error. - Use time constants. Changelog: Changed	2022-10-26 22:12:38 +02:00
Johann150	384e8c49b7	server: allow to like own gallery posts ... Since you are also allowed to react to your own notes, it seems sensible that you should be allowed to like your own gallery posts. Analogous to commit 4c5aa9e538. Changelog: Changed	2022-10-25 17:13:48 +02:00
Atsuko Karagi	c5e1c42d0a	backend: require authentification for fetch-rss ... Changelog: Changed	2022-10-25 08:56:34 -04:00
Atsuko Karagi	f74395c386	backend: remove unused endpoints ... Changelog: Removed	2022-10-25 08:56:31 -04:00
Atsuko Karagi	b2c483faf5	backend: tweak endpoint permissions ... Changelog: Changed	2022-10-25 08:36:39 -04:00
Atsuko Karagi	5bf1e5ad71	backend: federation information requires auth ... Changelog: Changed	2022-10-25 08:36:37 -04:00
Johann150	a0ef32f4f6	server: properly delete expired password reset requests ... Changelog: Fixed	2022-10-23 23:09:11 +02:00
Francis Dinh	7ec8729d90	backend: fix lint error in remove-note.ts	2022-10-21 17:52:15 -04:00
Francis Dinh	43644494d3	translate remaining comments	2022-10-21 13:33:03 -04:00
Francis Dinh	923c93da12	use await for notes.countBy	2022-10-20 21:22:52 -04:00
Francis Dinh	aa1e4d0fbc	change null assertion ternaries to use optional chaining	2022-10-20 21:22:52 -04:00
Francis Dinh	bfba54524d	backend: fix various type lints in services/note ... `createdAt` in `insertNote` now will default to the current date. Also refactor poll insert: Instead of testing hasPoll, just do a null check on data.poll since it's a more reliable indicator for whether a poll exists (and also tsc won't complain about data.poll being possibly null).	2022-10-20 21:22:24 -04:00
Francis Dinh	d83c1c3851	backend: use named exports for services/note	2022-10-20 21:16:34 -04:00
Francis Dinh	3da7221eec	backend: mark elasticsearch as optional	2022-10-20 21:15:48 -04:00
Johann150	9544cd69d2	fix typo	2022-10-20 21:26:12 +02:00
Johann150	b359b01700	improve docs	2022-10-20 21:22:34 +02:00
Johann150	cfb8723618	fix API definitions	2022-10-20 20:40:48 +02:00
Johann150	ee70ad52fc	server: error when trying to unclip note that is not clipped ... When a note is not added to a clip and an API call tries to remove the note from that clip, the API will now raise an error. Changelog: Changed	2022-10-19 21:54:37 +02:00
Johann150	4c5aa9e538	server: allow to like own pages ... Since you are also allowed to react to your own notes, it seems sensible that you should be allowed to like your own pages. Changelog: Changed	2022-10-19 21:52:43 +02:00
Johann150	4b6c3b2f37	properly await promise	2022-10-19 15:26:37 +02:00
Johann150	fbf7ea07c9	server refactor: centrally load locale ... To reduce code duplication, the locales are loaded in @/misc/i18n.ts directly instead of importing it in each file using it separately.	2022-10-19 12:30:23 +02:00
Johann150	507dede6da	default to english instead of japanese	2022-10-19 09:25:38 +02:00
Norm	7257338077	backend: make max note length configurable (#210) ... Changelog: Added Closes: FoundKeyGang/FoundKey#208 Co-authored-by: Francis Dinh <normandy@biribiri.dev> Reviewed-on: FoundKeyGang/FoundKey#210	2022-10-18 17:33:00 +00:00
Francis Dinh	3aa1d3bf97	backend: update DB_MAX_IMAGE_COMMENT_LENGTH ... This was increased to 2048 characters in 186d693385.	2022-10-17 17:49:48 -04:00
Francis Dinh	04d4dd323f	backend: use time constant in services/chart/index.ts	2022-10-16 18:22:18 -04:00
Francis Dinh	e814fdc7d1	backend: fix lints in services/drive	2022-10-16 18:20:20 -04:00
Francis Dinh	f2f547172e	backend: improve documentation of pin/update functions	2022-10-16 18:06:22 -04:00
Francis Dinh	f17485d8a2	backend: add type annotations to delete.ts	2022-10-16 17:14:30 -04:00
Francis Dinh	70eec26b74	bump versions in all package.json files	2022-10-16 11:46:12 -04:00
Chloe Kudryavtsev	811d5cd0d7	Merge pull request 'deliver Delete activities to all known instances' (#198) from deliver-delete-everyone into main ... Reviewed-on: FoundKeyGang/FoundKey#198	2022-10-16 13:46:23 +00:00
Chloe Kudryavtsev	d762143b89	backend: fixup missing deadTime and incorrect import	2022-10-16 09:32:01 -04:00
Chloe Kudryavtsev	21c1e5c06c	backend: simplify suspended and dead queries ... This should also have better latency due to being a single query. Furthermore, it's no longer a linear scan, since host is indexed. Would be cool to simplify it further to a single query for blocks also... Why exactly are blocks not in the db?	2022-10-16 09:22:05 -04:00
Chloe Kudryavtsev	91a4f38871	backend: add automatic dead instance detection ... It works by having a day-long cache of "when did we last successfully communicate with this instance?" Anything over a specified threshold (1 month) will act as though the instance is suspended - all outgoing jobs are dropped on processing. The day-long cache is in place because the ordering is necessarily a linear scan. Once an instance comes back online, we will detect that is the case as soon as we receive an activity from them (which will update the "last communicated at") field. Potential future TODOs: * Improve the caching system, it's actually pretty inefficient as it is. CacheBox with a call override? * Think of ways to make it not-a-linear-scan, since the instances table can get pretty big. It's around 4500 on toast cafe. ChangeLog: Added	2022-10-16 12:16:04 +00:00
Johann150	756ecbb1f7	fix type error	2022-10-16 04:20:11 +02:00
Johann150	cb0b14ba2d	backend: allow to export only specific emoji	2022-10-12 01:49:53 +02:00
Johann150	7cd11e7afd	fix function name	2022-10-11 21:26:20 +02:00
Johann150	0b8fa2665c	use DISTINCT instead of GROUP BY ... This should have better performance for large recordsets. Ref: FoundKeyGang/FoundKey#198 (comment)	2022-10-11 20:15:59 +02:00
Johann150	421b42d07d	backend: send delete activity to all known instances ... closes FoundKeyGang/FoundKey#190 Changelog: Added	2022-10-11 19:32:26 +02:00
Norm	9a503273fb	Merge pull request 'refactor meta API endpoint' (#196) from refactor/api/meta into main	2022-10-11 17:20:51 +00:00
Norm	20a6140e9a	Merge pull request 'backend: Cleanup prelude directory' (#199) from backend-cleanup-prelude into main ... Reviewed-on: FoundKeyGang/FoundKey#199	2022-10-11 14:47:40 +00:00
Chloe Kudryavtsev	6d58d5ed3b	fixup: muted-renotes review round 1	2022-10-11 10:42:39 +00:00
Chloe Kudryavtsev	897658c188	import publishUserEvent in mute renote APIs	2022-10-11 10:42:39 +00:00
Chloe Kudryavtsev	590a8b98d9	fixup renoteMuting stream filter being overzealous	2022-10-11 10:42:39 +00:00
Chloe Kudryavtsev	dd5100d124	add streaming events for renotemuting and blocking	2022-10-11 10:42:39 +00:00
Chloe Kudryavtsev	3d9df839a5	add down-migration for renote mutes	2022-10-11 10:42:39 +00:00
Hélène	c414f24a2c	feat: per-user renote muting ... Changelog: Added	2022-10-11 10:42:39 +00:00
Michcio	60600729df	backend: Fix import of sanitize-html ... I'm not sure how it managed to work so far, but the function is the default export, using the namespace like a function should not have worked, maybe something under the hood was correcting it back	2022-10-11 10:41:50 +02:00
Francis Dinh	683b0cfa82	backend: remove unused prelude modules ... Much of these modules are no longer used in the backend. They seem to be from before the code was organized in packages.	2022-10-11 01:53:34 -04:00
Francis Dinh	c65559872b	backend: add missing return type annotation in array.ts	2022-10-11 01:51:17 -04:00
Francis Dinh	13a3581817	Merge branch 'refactor/use-null-coalesce-etc' ... Reviewed-on: FoundKeyGang/FoundKey#195	2022-10-10 18:44:19 -04:00
Johann150	808c43377e	refactor: use nullish coalescing & optional chaining ... Changes several places to use the afforementioned constructs in favour of ternary expressions.	2022-10-11 00:39:27 +02:00
Johann150	8920eeb86a	ActivityPub: allow all known shared inboxes to be addressed ... This is oriented on this paragraph from the AP spec: > Additionally, if an object is addressed to the Public special collection, > a server MAY deliver that object to all known sharedInbox endpoints > on the network.	2022-10-11 00:27:43 +02:00
Norm	91c043689b	Merge pull request 'backend: Fix imports from weird paths' (#192) from Michcio/FoundKey-0x7f:extensionless-imports into main ... Reviewed-on: FoundKeyGang/FoundKey#192	2022-10-10 18:58:54 +00:00
Michcio	30faeb73d2	backend: Fix type errors in genId ... I checked on NodeJS locally and `Math.min` was coercing the Dates to numbers, I'm just making it more obvious (to the typechecker as well)	2022-10-10 20:50:04 +02:00
Michcio	dc510c6834	Fix imports from weird paths ... These imports were breaking in TS error checking and VS Code, because imports need to have an extension to be valid, apparently	2022-10-10 20:45:45 +02:00
Michcio	a91bbed34e	Make it impossible to start initializing Vue before DOM exists	2022-10-10 14:22:48 -04:00
Johann150	9022ab9f2a	backend: ignore detail parameter on meta endpoint ... Also allow meta endpoint to be fetched via GET. Changelog: Removed	2022-10-10 17:36:13 +02:00
Francis Dinh	c20352b22e	backend: update THRESHOLD constants to use time constants	2022-10-05 00:54:16 -04:00
Francis Dinh	9084864b34	backend: translate comments in const.ts	2022-10-05 00:52:52 -04:00
Norm	a6d1284423	backend: change Misskey -> FoundKey and use absolute import in index.ts	2022-10-03 20:04:06 +00:00
Norm	8ccc22bb35	Merge pull request 'refactor expiring data and expire signins after 60 days' (#180) from expire-data into main ... Reviewed-on: FoundKeyGang/FoundKey#180	2022-10-03 18:27:13 +00:00
Michcio	ffcb840e06	Fix type in thread muting	2022-10-03 13:24:27 -04:00
Johann150	a7f9e244f3	merge: allow redis family to be specified as a string ... Reviewed-on: FoundKeyGang/FoundKey#165	2022-10-02 18:46:34 +02:00
Johann150	5b7a06675f	refactor expiring data and expire signins after 60 days ... closes FoundKeyGang/FoundKey#176 Changelog: Added	2022-10-02 00:18:07 +02:00
Johann150	36a0e48e49	bacakend: prefer absolute over relative imports ... There are still many places where import paths with `..` are used and maybe should use absolute paths also.	2022-10-01 14:40:30 +02:00
Francis Dinh	8ca544c45d	remove outgoingAddressFamily	2022-09-30 11:05:50 -04:00
Francis Dinh	29164740b9	fix warning message	2022-09-30 11:05:50 -04:00
Francis Dinh	508748ac0d	backend: refactor Redis option loading	2022-09-30 11:05:49 -04:00
Francis Dinh	5a52532c99	allow redis family to be specified as a string ... This makes it consistent with `outgoingAddressFamily`, reducing potential confusion. For compatibility reasons, numbers are still permitted for `redis.family` with the following mapping: - `dual` = `0` - `ipv4` = `4` - `ipv6` = `6` Changelog: Changed	2022-09-30 11:05:49 -04:00
Norm	465b72ab53	Merge pull request 'increase image description limit to 2048 characters' (#174) from bigger-image-description into main ... Reviewed-on: FoundKeyGang/FoundKey#174	2022-09-29 07:28:00 +00:00
Puniko	186d693385	increase image description limit to 2048 characters ... Changelog: Changed	2022-09-24 14:32:07 -04:00
Francis Dinh	f35b856dfa	backend: fix quotes lint in thread-muting/create.ts	2022-09-23 23:02:39 -04:00
Michcio	2bb8642a2c	backend: Fix thread muting queries ... findOne != findOneBy	2022-09-25 15:08:12 +02:00
Norm	9470e12424	Merge pull request 'Revert "Use native shell commands for clean/clean-all"' (#170) from revert-native-clean into main ... Reviewed-on: FoundKeyGang/FoundKey#170	2022-09-23 22:15:29 +00:00
Norm	dba63e4000	Merge pull request 'mute notifications in muted threads' (#119) from mute-notifications into main ... Reviewed-on: FoundKeyGang/FoundKey#119 Changelog: Changed Fixes: #12	2022-09-22 19:52:32 +00:00
Francis Dinh	d9a64d0a22	Revert "Use native shell commands for clean/clean-all" ... This reverts commit 5fb294e7d7. This will allow the clean/clean-all command to work on Windows once again.	2022-09-22 13:48:06 -04:00
Francis Dinh	1b92f580cb	backend: fix imports in queue/types.ts	2022-09-21 13:18:17 -04:00
Johann150	0022a7befb	backend: proper error messages for creating accounts ... Admins will now get proper error messages when they try to create a new user account and an error occurs. Changelog: Fixed	2022-09-21 17:58:42 +02:00
Johann150	cc5a197785	do not create muted notification types in respective threads	2022-09-21 17:54:36 +02:00
Johann150	87411a6ed8	enhance: more descriptive info message	2022-09-21 17:54:36 +02:00
Francis Dinh	7ea052aa25	backend: set moduleResolution to Node16 in tsconfig ... This lets us catch any import errors in the backend as it now lines up with Node's ESM module resolution.	2022-09-21 11:33:57 -04:00
Johann150	321bd24b98	api: handle muting notification types	2022-09-21 15:52:34 +02:00
Johann150	58aa7d36aa	refactor: use noteNotificationTypes	2022-09-21 15:52:34 +02:00
Johann150	35fd970c4a	add column: muted types in thread	2022-09-21 15:52:14 +02:00
Francis Dinh	26449d4944	backend: fix ApiError lints	2022-09-21 13:34:36 +02:00