738 commits

Author	SHA1	Message	Date
Francis Dinh	b18c9b27a6	backend: minor cleanup of nodeinfo.ts ... Copy over the MONTH constant from the client code and the time constants for active{Halfyear,Month}. Also instead of adding and deleting `respository` from the nodeinfo for version 2.0, only add in the repository URL in the 2.1 endpoint.	2022-11-16 17:52:13 -05:00
Johann150	b958be77b6	fixup server: refactor meta caching ... fix: setting meta does not keep cache synced. fix: handle initially empty meta table.	2022-11-16 20:36:22 +01:00
Johann150	9f6be8d557	server: refactor meta caching ... This removes the "caching" that re-fetches the instance meta information from the database every 10 seconds.	2022-11-14 22:12:32 +01:00
Johann150	9d9b2da6cc	fix parameter for cache fetcher	2022-11-13 20:31:24 +01:00
Johann150	d1ec058d5c	server: refactor Cache to hold fetcher as attribute ... Instead of having to pass the fetcher every time you want to fetch something, the fetcher is stored in an attribute of the Cache.	2022-11-13 19:39:30 +01:00
Johann150	131c12a30b	server: refactor prefetchEmojis ... Exiting earlier might slightly improve performance.	2022-11-13 18:24:15 +01:00
Johann150	8d6476af2a	server: remove localUserByIdCache ... The same data is stored in userByIdCache. Whether a user is local or not can easily be determined from the cached object.	2022-11-13 18:03:22 +01:00
Johann150	57299f0df6	server: simplify caching for instance actor	2022-11-13 17:14:33 +01:00
Johann150	b0489abd7f	translate japanese comments	2022-11-13 13:47:22 +01:00
Johann150	a3468491a7	fix import	2022-11-12 18:51:57 +01:00
Johann150	486be564e8	server: improve comments	2022-11-12 17:39:36 +01:00
Johann150	c49f529ccb	server: use DeliverManager for user deletion	2022-11-12 15:23:49 +01:00
Johann150	8979e779da	server: optimise follower inboxes query ... Use the distinct query thingy so we don't have to make the Set work so hard. This is also uniform code with the "everyone" above so should hopefully be easier to understand.	2022-11-12 15:09:50 +01:00
Johann150	f3c38ad5c8	server: only add unique cascade-delete notes	2022-11-11 18:08:57 +01:00
Johann150	899b01a031	remove unnecessary checks ... These checks were made obsolete by commit 6df2f7c55c.	2022-11-11 18:07:49 +01:00
Johann150	a27a29b371	server: redirect browsers to human readable page ... Also added/translated more comments.	2022-11-11 17:54:11 +01:00
Johann150	66a9d27ab1	server: increase user description length to 2048 ... Changelog: Changed	2022-11-11 12:28:57 +01:00
Francis Dinh	d411ea6281	backend: make removeAds migration plain JS	2022-11-10 12:56:39 -05:00
Johann150	5d23aa9e69	translate some comments to english	2022-11-10 00:36:39 +01:00
Johann150	5b61941e4c	server: skip instances that proclaimed themself dead via HTTP 410 ... Changelog: Fixed	2022-11-10 00:23:30 +01:00
Johann150	ca90cedba0	server: reduce dead instance detection to 7 days	2022-11-09 18:47:28 +01:00
Johann150	54075789cd	server: remove content type bodge ... Now that the client should send the proper content type, this should not be necessary any more.	2022-11-08 20:57:38 +01:00
Johann150	609312bb82	server: refactor errors in signin endpoint	2022-11-08 20:57:08 +01:00
Francis Dinh	7939d130aa	backend: update sharp to 0.31.2 ... Changelog: Fixed Fixes: FoundKeyGang/FoundKey#226	2022-11-08 01:16:55 -05:00
Johann150	489eea0c67	server: improve API validation for creating apps ... Resolves a FIXME comment.	2022-11-05 10:43:34 +01:00
Johann150	6f65326b32	chore: synchronize code and database schema	2022-11-03 21:50:55 +01:00
Norm	e8ecd71f8a	backend: refactor server/nodeinfo.ts (#221) ... This fixes a few type errors like removing `software.respository` in NodeInfo 2.0 and updating `metadata.repositoryUrl` to not use the now removed meta `repositoryUrl` field. Co-authored-by: Francis Dinh <normandy@biribiri.dev> Reviewed-on: FoundKeyGang/FoundKey#221	2022-11-02 21:42:51 +00:00
Francis Dinh	0db0db9a87	backend: fix types in getRedisFamily	2022-10-31 18:39:05 -04:00
Johann150	6df2f7c55c	server: refactor finding delete-cascaded notes ... Remove the several filter functions in different places by filtering directly in the database. Instead of a QueryBuilder, use the plain find function. Refactor a for loop awaiting several promises individually, use Array.map and await Promise.all to make better use of promises.	2022-10-31 20:57:45 +01:00
Johann150	ac240eb58d	server: translate/add comments	2022-10-31 20:57:18 +01:00
Michcio	d725f93d40	backend: Provide type for signedGet	2022-10-31 10:10:29 +01:00
Michcio	6db9b76f46	Retouch types in server index	2022-10-31 10:10:29 +01:00
Michcio	f50b04b015	Fix type errors in withPackedNote	2022-10-31 10:10:28 +01:00
Michcio	3fe1f7e70e	Deal with withPackedNote(onNote) types in stream channels	2022-10-31 10:10:28 +01:00
Michcio	eff9dbb5ee	Reassure typechecker about token in authenticate	2022-10-31 10:10:28 +01:00
Michcio	fb80fd1fbd	Broaden type in authenticate as undefined is also nullable	2022-10-31 10:10:27 +01:00
Michcio	2a33d0ac83	Fix type import in stream emitter typing	2022-10-31 10:10:27 +01:00
Michcio	fb5f498641	Upgrade bull-board to unify misaligned types in its packages	2022-10-31 10:10:27 +01:00
Michcio	23fbdfdf1f	Fix typos in syslog initialization	2022-10-31 10:10:26 +01:00
Francis Dinh	5b7a7794ab	backend: fix type of IEndpointMeta.errors ... The errors array is supposed to be readonly.	2022-10-31 03:35:47 -04:00
Johann150	bd0c06e2d0	server: fix RefereceError (again...)	2022-10-30 17:46:44 +01:00
Michcio	c282ed7683	Narrow type of isPureRenote ... As side effect of that, a non-null assertion can be removed. Co-authored-by: Johann150 <johann.galle@protonmail.com>	2022-10-30 17:38:56 +01:00
Johann150	240ad1cca6	server: fix ReferenceError ... The super constructor has to be called before accessing this.	2022-10-30 16:22:12 +01:00
Johann150	2aafe8fc9f	server: avoid adding suspended instances to deliver queue ... This should reduce the performance hit when adding large numbers of instances to the deliver queue by making the check for suspended and dead instances a bulk operation. Changelog: Changed Reviewed-on: FoundKeyGang/FoundKey#215	2022-10-29 22:58:04 +02:00
Johann150	7a64a3858d	fix erroneous quote	2022-10-28 23:49:30 +02:00
Johann150	d0564759a5	server: remove unnecessary argument	2022-10-28 23:36:47 +02:00
Johann150	735b9ab502	fix some lints	2022-10-28 16:57:56 +02:00
Johann150	fb76843c19	adapt OpenAPI documentation generation to new error definitions	2022-10-27 22:44:06 +02:00
Johann150	1dd935dc0c	fix endpoint type definition for errors	2022-10-27 22:44:06 +02:00
Johann150	934ee82b8f	server: refactor ApiError to store error descriptions centrally ... The UUIDs are no longer used for errors and all errors should now have a descriptive message attached to them. Also, all errors should now have the proper HTTP status code for a reply instead of the generic 400 and 500 response codes. Because the errors all have more specific error codes, the "kind" of client or server is also abolished.	2022-10-27 22:43:58 +02:00
Johann150	66d7b69377	server: refactor API handler and returning errors ... This refactors the API handler to not use default exports, be async instead of constructing a promise and modify how errors are returned.	2022-10-26 23:15:31 +02:00
Johann150	c3c7164dfb	fix merge of #213	2022-10-26 22:53:06 +02:00
Johann150	a991740e00	server: improve API definition for messaging/messages/create	2022-10-26 22:21:28 +02:00
Johann150	4dc97d5b65	server: enhance reset-password endpoint ... - Add a rate limit analogous to request-reset-password. See also a0ef32f4f6. - Delete an expired reset request if found. - Return a proper error. - Use time constants. Changelog: Changed	2022-10-26 22:12:38 +02:00
Johann150	384e8c49b7	server: allow to like own gallery posts ... Since you are also allowed to react to your own notes, it seems sensible that you should be allowed to like your own gallery posts. Analogous to commit 4c5aa9e538. Changelog: Changed	2022-10-25 17:13:48 +02:00
Atsuko Karagi	c5e1c42d0a	backend: require authentification for fetch-rss ... Changelog: Changed	2022-10-25 08:56:34 -04:00
Atsuko Karagi	f74395c386	backend: remove unused endpoints ... Changelog: Removed	2022-10-25 08:56:31 -04:00
Atsuko Karagi	b2c483faf5	backend: tweak endpoint permissions ... Changelog: Changed	2022-10-25 08:36:39 -04:00
Atsuko Karagi	5bf1e5ad71	backend: federation information requires auth ... Changelog: Changed	2022-10-25 08:36:37 -04:00
Johann150	a0ef32f4f6	server: properly delete expired password reset requests ... Changelog: Fixed	2022-10-23 23:09:11 +02:00
Francis Dinh	7ec8729d90	backend: fix lint error in remove-note.ts	2022-10-21 17:52:15 -04:00
Francis Dinh	43644494d3	translate remaining comments	2022-10-21 13:33:03 -04:00
Francis Dinh	923c93da12	use await for notes.countBy	2022-10-20 21:22:52 -04:00
Francis Dinh	aa1e4d0fbc	change null assertion ternaries to use optional chaining	2022-10-20 21:22:52 -04:00
Francis Dinh	bfba54524d	backend: fix various type lints in services/note ... `createdAt` in `insertNote` now will default to the current date. Also refactor poll insert: Instead of testing hasPoll, just do a null check on data.poll since it's a more reliable indicator for whether a poll exists (and also tsc won't complain about data.poll being possibly null).	2022-10-20 21:22:24 -04:00
Francis Dinh	d83c1c3851	backend: use named exports for services/note	2022-10-20 21:16:34 -04:00
Francis Dinh	3da7221eec	backend: mark elasticsearch as optional	2022-10-20 21:15:48 -04:00
Johann150	9544cd69d2	fix typo	2022-10-20 21:26:12 +02:00
Johann150	b359b01700	improve docs	2022-10-20 21:22:34 +02:00
Johann150	cfb8723618	fix API definitions	2022-10-20 20:40:48 +02:00
Johann150	ee70ad52fc	server: error when trying to unclip note that is not clipped ... When a note is not added to a clip and an API call tries to remove the note from that clip, the API will now raise an error. Changelog: Changed	2022-10-19 21:54:37 +02:00
Johann150	4c5aa9e538	server: allow to like own pages ... Since you are also allowed to react to your own notes, it seems sensible that you should be allowed to like your own pages. Changelog: Changed	2022-10-19 21:52:43 +02:00
Johann150	4b6c3b2f37	properly await promise	2022-10-19 15:26:37 +02:00
Johann150	fbf7ea07c9	server refactor: centrally load locale ... To reduce code duplication, the locales are loaded in @/misc/i18n.ts directly instead of importing it in each file using it separately.	2022-10-19 12:30:23 +02:00
Johann150	507dede6da	default to english instead of japanese	2022-10-19 09:25:38 +02:00
Norm	7257338077	backend: make max note length configurable (#210) ... Changelog: Added Closes: FoundKeyGang/FoundKey#208 Co-authored-by: Francis Dinh <normandy@biribiri.dev> Reviewed-on: FoundKeyGang/FoundKey#210	2022-10-18 17:33:00 +00:00
Francis Dinh	3aa1d3bf97	backend: update DB_MAX_IMAGE_COMMENT_LENGTH ... This was increased to 2048 characters in 186d693385.	2022-10-17 17:49:48 -04:00
Francis Dinh	04d4dd323f	backend: use time constant in services/chart/index.ts	2022-10-16 18:22:18 -04:00
Francis Dinh	e814fdc7d1	backend: fix lints in services/drive	2022-10-16 18:20:20 -04:00
Francis Dinh	f2f547172e	backend: improve documentation of pin/update functions	2022-10-16 18:06:22 -04:00
Francis Dinh	f17485d8a2	backend: add type annotations to delete.ts	2022-10-16 17:14:30 -04:00
Francis Dinh	70eec26b74	bump versions in all package.json files	2022-10-16 11:46:12 -04:00
Chloe Kudryavtsev	811d5cd0d7	Merge pull request 'deliver Delete activities to all known instances' (#198) from deliver-delete-everyone into main ... Reviewed-on: FoundKeyGang/FoundKey#198	2022-10-16 13:46:23 +00:00
Chloe Kudryavtsev	d762143b89	backend: fixup missing deadTime and incorrect import	2022-10-16 09:32:01 -04:00
Chloe Kudryavtsev	21c1e5c06c	backend: simplify suspended and dead queries ... This should also have better latency due to being a single query. Furthermore, it's no longer a linear scan, since host is indexed. Would be cool to simplify it further to a single query for blocks also... Why exactly are blocks not in the db?	2022-10-16 09:22:05 -04:00
Chloe Kudryavtsev	91a4f38871	backend: add automatic dead instance detection ... It works by having a day-long cache of "when did we last successfully communicate with this instance?" Anything over a specified threshold (1 month) will act as though the instance is suspended - all outgoing jobs are dropped on processing. The day-long cache is in place because the ordering is necessarily a linear scan. Once an instance comes back online, we will detect that is the case as soon as we receive an activity from them (which will update the "last communicated at") field. Potential future TODOs: * Improve the caching system, it's actually pretty inefficient as it is. CacheBox with a call override? * Think of ways to make it not-a-linear-scan, since the instances table can get pretty big. It's around 4500 on toast cafe. ChangeLog: Added	2022-10-16 12:16:04 +00:00
Johann150	756ecbb1f7	fix type error	2022-10-16 04:20:11 +02:00
Johann150	cb0b14ba2d	backend: allow to export only specific emoji	2022-10-12 01:49:53 +02:00
Johann150	7cd11e7afd	fix function name	2022-10-11 21:26:20 +02:00
Johann150	0b8fa2665c	use DISTINCT instead of GROUP BY ... This should have better performance for large recordsets. Ref: FoundKeyGang/FoundKey#198 (comment)	2022-10-11 20:15:59 +02:00
Johann150	421b42d07d	backend: send delete activity to all known instances ... closes FoundKeyGang/FoundKey#190 Changelog: Added	2022-10-11 19:32:26 +02:00
Norm	9a503273fb	Merge pull request 'refactor meta API endpoint' (#196) from refactor/api/meta into main	2022-10-11 17:20:51 +00:00
Norm	20a6140e9a	Merge pull request 'backend: Cleanup prelude directory' (#199) from backend-cleanup-prelude into main ... Reviewed-on: FoundKeyGang/FoundKey#199	2022-10-11 14:47:40 +00:00
Chloe Kudryavtsev	6d58d5ed3b	fixup: muted-renotes review round 1	2022-10-11 10:42:39 +00:00
Chloe Kudryavtsev	897658c188	import publishUserEvent in mute renote APIs	2022-10-11 10:42:39 +00:00
Chloe Kudryavtsev	590a8b98d9	fixup renoteMuting stream filter being overzealous	2022-10-11 10:42:39 +00:00
Chloe Kudryavtsev	dd5100d124	add streaming events for renotemuting and blocking	2022-10-11 10:42:39 +00:00
Chloe Kudryavtsev	3d9df839a5	add down-migration for renote mutes	2022-10-11 10:42:39 +00:00
Hélène	c414f24a2c	feat: per-user renote muting ... Changelog: Added	2022-10-11 10:42:39 +00:00
Michcio	60600729df	backend: Fix import of sanitize-html ... I'm not sure how it managed to work so far, but the function is the default export, using the namespace like a function should not have worked, maybe something under the hood was correcting it back	2022-10-11 10:41:50 +02:00