9ad37a12f8
server: fix rendering of Follow activity when removing follow
...
closes FoundKeyGang/FoundKey#263
Changelog: Fixed
2022-12-01 21:49:38 +01:00
e10700a2be
Merge pull request 'server: add wildcard matching to blocked hosts' ( #260 ) from wildcard-block-v2 into main
...
Reviewed-on: FoundKeyGang/FoundKey#260
2022-12-01 20:12:18 +00:00
721a327192
fixup: remove unused import
2022-12-01 20:46:46 +01:00
936cbf900b
use default argument value
...
This unifies the style with the other function in that file and fixes
the lint "no-param-reassign".
2022-12-01 20:32:57 +01:00
b3e34795c0
require punycode conversion beforehand for admins
2022-12-01 12:07:43 -05:00
a35c98bbd5
server: encode non-ascii domains in punycode in matchHost
2022-12-01 11:34:11 -05:00
075e251822
server: add wildcard matching to blocked hosts
...
This adds in wildcard matching. For instance:
- `*.bad.tld` will match: `very.bad.tld`
- `bad.*` will match: `bad.something`
- `*.bad.*` will match: `very.bad.evil`
Changelog: Changed
2022-12-01 11:29:02 -05:00
Derek Schmidt
11a6e706f4
server: Use shared resolver in featured and question accept
2022-12-01 04:40:14 -05:00
Derek Schmidt
d3af00a912
server: Add recursion limit to resolver
...
Changelog: Security
2022-12-01 04:40:07 -05:00
973bd4532b
Merge pull request 'server: always enable push notifications' ( #235 ) from enable-push-notifs into main
...
Reviewed-on: FoundKeyGang/FoundKey#235
Changelog: Changed
2022-11-29 21:51:10 +00:00
5733f127ca
backend: update re2 to 1.17.8
...
This should fix Node 19 compatibility.
Fixes: FoundKeyGang/FoundKey#238
2022-11-28 12:02:24 -05:00
8130a2a9b1
server: remove deeplIsPro setting
...
This setting is unnecessary because DeepL free keys can be detected
easily according to <https://www.deepl.com/docs-api/api-access/authentication/ >:
> DeepL API Free authentication keys can be identified easily by the suffix ":fx"
Changelog: Removed
2022-11-27 12:12:56 +01:00
9fd23b5dae
server: remove quote urls, 3rd try
...
First try was 66a7c62342
but classList is
not in parse5 DOM. Second try was 7ee6a09cf2
but forgot the contents of this commit.
2022-11-27 09:30:51 +01:00
6600f6e52e
fixup: make cluster limit into a per-mode warning rather than error
2022-11-26 13:28:39 +01:00
d0c504ec85
server: fix unknown variable in signin endpoint
2022-11-25 19:09:08 +01:00
062cba1b3c
server: fix undefined variable for instance actor
2022-11-25 19:05:37 +01:00
48a60b03ea
BREAKING: implement separate web workers
...
There are now separate web and queue workers.
The configuration entry `clusterLimit` has been replaced by
`clusterLimits` which allows separate configuration of web and
queue workers.
Changelog: Changed
2022-11-25 12:56:49 +01:00
f817d45210
update eslint and typescript-eslint
2022-11-25 02:07:21 -05:00
b67799ad3f
BREAKING: Remove support for Node 16.x and upgrade to TypeScript 4.9
...
Now that Node 18 is the new LTS version of Node, it should be safe to
support ES2022 features. The install docs have already been updated to
recommend Node 18.x in 41a710854e
.
This will break support on Node 16.x and earlier.
Also update TypeScript to 4.9 which contains various typechecking
improvements: https://devblogs.microsoft.com/typescript/announcing-typescript-4-9/
Ref: FoundKeyGang/FoundKey#238
Changelog: Changed
2022-11-25 02:07:21 -05:00
01fa4332c2
server: set vapid keys on initial setup
2022-11-21 22:30:34 +01:00
563f3672a9
server: always enable push notifications
...
The thing that previously presumably hindered this was that the VAPID
keys had to be set up. Previously admins had to do this, but this is a bad
idea for multiple reasons:
1) The meaning of "public key" and "private key" was not well documented
in the settings.
2) Giving out a private key over the API, even just for admins, sounds
like a bad idea.
Co-authored-by: Francis Dinh <normandy@biribiri.dev>
2022-11-21 22:00:53 +01:00
7ee6a09cf2
fix errors from quote string removal
...
The parse5 tree does not have the full DOM methods and attributes.
2022-11-21 19:43:56 +01:00
9e2553909e
server: use time constants
2022-11-20 23:15:40 +01:00
66a7c62342
activitypub: remove akkoma quote URLs
...
Changelog: Fixed
2022-11-20 20:48:15 +00:00
512351746f
Merge pull request 'Add LibreTranslate support' ( #224 ) from libretranslate into main
...
Reviewed-on: FoundKeyGang/FoundKey#224
Changelog: Added
2022-11-20 16:21:17 +00:00
kabo2468
b7f32be512
server: don't nyaize quoted lines
...
Co-authored-by: syuilo <Syuilotan@yahoo.co.jp>
Changelog: Changed
2022-11-20 11:15:03 +01:00
aefb11959f
fix: translator settings on admin/meta endpoint
2022-11-20 10:37:50 +01:00
8cde66b8ac
backend: Add LibreTranslate support
2022-11-19 23:00:33 -05:00
7ffe2181a9
server: use host parameter in note search without elasticsearch
...
Changelog: Fixed
2022-11-19 17:33:27 +01:00
4183c429e6
server: rewrite skipped instances query in raw SQL
...
This should hopefully improve performance somewhat.
Reviewed-on: FoundKeyGang/FoundKey#230
Changelog: Changed
2022-11-18 22:02:47 +01:00
28aa440bcc
server: correctly await promises when updating server info
...
When not awaiting promises, truncating the table and inserting again
can sometimes not work due to race conditions.
2022-11-18 20:52:19 +01:00
71b3b5a60c
backend: implement not forwarding block activities ( #212 )
...
Fixes FoundKeyGang/FoundKey#211
Commits pulled from https://github.com/misskey-dev/misskey/pull/7799
Changelog: Added
Co-authored-by: FloatingGhost <hannah@coffee-and-dreams.uk>
Co-authored-by: Johann150 <johann.galle@protonmail.com>
Co-authored-by: Francis Dinh <normandy@biribiri.dev>
Reviewed-on: FoundKeyGang/FoundKey#212
2022-11-17 21:24:38 +00:00
110c645a97
Merge pull request 'backend: fix activitypub.ts lints' ( #236 ) from refactor/activitypub-ts into main
...
Reviewed-on: FoundKeyGang/FoundKey#236
2022-11-17 19:48:08 +00:00
ddeb5b25f1
translate comments in chart core
2022-11-17 20:23:17 +01:00
c0d5678039
backend: fix lints in various misc modules
...
Mostly adding return types and also fixing a type error.
2022-11-16 19:48:16 -05:00
629b865789
backend: add return type to getAntennas
2022-11-16 19:44:20 -05:00
021d523d5f
backend: fix activitypub.ts lints
2022-11-16 19:38:32 -05:00
848b9bcdf1
backend: partially revert repo url change in nodeinfo
2022-11-16 17:58:55 -05:00
b18c9b27a6
backend: minor cleanup of nodeinfo.ts
...
Copy over the MONTH constant from the client code and the time constants
for active{Halfyear,Month}.
Also instead of adding and deleting `respository` from the nodeinfo for
version 2.0, only add in the repository URL in the 2.1 endpoint.
2022-11-16 17:52:13 -05:00
b958be77b6
fixup server: refactor meta caching
...
fix: setting meta does not keep cache synced.
fix: handle initially empty meta table.
2022-11-16 20:36:22 +01:00
9f6be8d557
server: refactor meta caching
...
This removes the "caching" that re-fetches the instance meta information
from the database every 10 seconds.
2022-11-14 22:12:32 +01:00
9d9b2da6cc
fix parameter for cache fetcher
2022-11-13 20:31:24 +01:00
d1ec058d5c
server: refactor Cache to hold fetcher as attribute
...
Instead of having to pass the fetcher every time you want to fetch
something, the fetcher is stored in an attribute of the Cache.
2022-11-13 19:39:30 +01:00
131c12a30b
server: refactor prefetchEmojis
...
Exiting earlier might slightly improve performance.
2022-11-13 18:24:15 +01:00
8d6476af2a
server: remove localUserByIdCache
...
The same data is stored in userByIdCache. Whether a user is local or not
can easily be determined from the cached object.
2022-11-13 18:03:22 +01:00
57299f0df6
server: simplify caching for instance actor
2022-11-13 17:14:33 +01:00
b0489abd7f
translate japanese comments
2022-11-13 13:47:22 +01:00
a3468491a7
fix import
2022-11-12 18:51:57 +01:00
486be564e8
server: improve comments
2022-11-12 17:39:36 +01:00
c49f529ccb
server: use DeliverManager for user deletion
2022-11-12 15:23:49 +01:00
8979e779da
server: optimise follower inboxes query
...
Use the distinct query thingy so we don't have to make the Set work
so hard. This is also uniform code with the "everyone" above so should
hopefully be easier to understand.
2022-11-12 15:09:50 +01:00
f3c38ad5c8
server: only add unique cascade-delete notes
2022-11-11 18:08:57 +01:00
899b01a031
remove unnecessary checks
...
These checks were made obsolete by commit
6df2f7c55c
.
2022-11-11 18:07:49 +01:00
a27a29b371
server: redirect browsers to human readable page
...
Also added/translated more comments.
2022-11-11 17:54:11 +01:00
66a9d27ab1
server: increase user description length to 2048
...
Changelog: Changed
2022-11-11 12:28:57 +01:00
d411ea6281
backend: make removeAds migration plain JS
2022-11-10 12:56:39 -05:00
5d23aa9e69
translate some comments to english
2022-11-10 00:36:39 +01:00
5b61941e4c
server: skip instances that proclaimed themself dead via HTTP 410
...
Changelog: Fixed
2022-11-10 00:23:30 +01:00
ca90cedba0
server: reduce dead instance detection to 7 days
2022-11-09 18:47:28 +01:00
54075789cd
server: remove content type bodge
...
Now that the client should send the proper content type, this should not be
necessary any more.
2022-11-08 20:57:38 +01:00
609312bb82
server: refactor errors in signin endpoint
2022-11-08 20:57:08 +01:00
7939d130aa
backend: update sharp to 0.31.2
...
Changelog: Fixed
Fixes: FoundKeyGang/FoundKey#226
2022-11-08 01:16:55 -05:00
489eea0c67
server: improve API validation for creating apps
...
Resolves a FIXME comment.
2022-11-05 10:43:34 +01:00
6f65326b32
chore: synchronize code and database schema
2022-11-03 21:50:55 +01:00
e8ecd71f8a
backend: refactor server/nodeinfo.ts ( #221 )
...
This fixes a few type errors like removing `software.respository` in
NodeInfo 2.0 and updating `metadata.repositoryUrl` to not use the
now removed meta `repositoryUrl` field.
Co-authored-by: Francis Dinh <normandy@biribiri.dev>
Reviewed-on: FoundKeyGang/FoundKey#221
2022-11-02 21:42:51 +00:00
0db0db9a87
backend: fix types in getRedisFamily
2022-10-31 18:39:05 -04:00
6df2f7c55c
server: refactor finding delete-cascaded notes
...
Remove the several filter functions in different places by filtering
directly in the database.
Instead of a QueryBuilder, use the plain find function.
Refactor a for loop awaiting several promises individually, use
Array.map and await Promise.all to make better use of promises.
2022-10-31 20:57:45 +01:00
ac240eb58d
server: translate/add comments
2022-10-31 20:57:18 +01:00
d725f93d40
backend: Provide type for signedGet
2022-10-31 10:10:29 +01:00
6db9b76f46
Retouch types in server index
2022-10-31 10:10:29 +01:00
f50b04b015
Fix type errors in withPackedNote
2022-10-31 10:10:28 +01:00
3fe1f7e70e
Deal with withPackedNote(onNote) types in stream channels
2022-10-31 10:10:28 +01:00
eff9dbb5ee
Reassure typechecker about token in authenticate
2022-10-31 10:10:28 +01:00
fb80fd1fbd
Broaden type in authenticate as undefined is also nullable
2022-10-31 10:10:27 +01:00
2a33d0ac83
Fix type import in stream emitter typing
2022-10-31 10:10:27 +01:00
fb5f498641
Upgrade bull-board to unify misaligned types in its packages
2022-10-31 10:10:27 +01:00
23fbdfdf1f
Fix typos in syslog initialization
2022-10-31 10:10:26 +01:00
5b7a7794ab
backend: fix type of IEndpointMeta.errors
...
The errors array is supposed to be readonly.
2022-10-31 03:35:47 -04:00
bd0c06e2d0
server: fix RefereceError (again...)
2022-10-30 17:46:44 +01:00
c282ed7683
Narrow type of isPureRenote
...
As side effect of that, a non-null assertion can be removed.
Co-authored-by: Johann150 <johann.galle@protonmail.com>
2022-10-30 17:38:56 +01:00
240ad1cca6
server: fix ReferenceError
...
The super constructor has to be called before accessing this.
2022-10-30 16:22:12 +01:00
2aafe8fc9f
server: avoid adding suspended instances to deliver queue
...
This should reduce the performance hit when adding large numbers of
instances to the deliver queue by making the check for suspended and
dead instances a bulk operation.
Changelog: Changed
Reviewed-on: FoundKeyGang/FoundKey#215
2022-10-29 22:58:04 +02:00
7a64a3858d
fix erroneous quote
2022-10-28 23:49:30 +02:00
d0564759a5
server: remove unnecessary argument
2022-10-28 23:36:47 +02:00
735b9ab502
fix some lints
2022-10-28 16:57:56 +02:00
fb76843c19
adapt OpenAPI documentation generation to new error definitions
2022-10-27 22:44:06 +02:00
1dd935dc0c
fix endpoint type definition for errors
2022-10-27 22:44:06 +02:00
934ee82b8f
server: refactor ApiError to store error descriptions centrally
...
The UUIDs are no longer used for errors and all errors should now have
a descriptive message attached to them. Also, all errors should now have
the proper HTTP status code for a reply instead of the generic 400 and 500
response codes. Because the errors all have more specific error codes, the
"kind" of client or server is also abolished.
2022-10-27 22:43:58 +02:00
66d7b69377
server: refactor API handler and returning errors
...
This refactors the API handler to not use default exports, be async
instead of constructing a promise and modify how errors are returned.
2022-10-26 23:15:31 +02:00
c3c7164dfb
fix merge of #213
2022-10-26 22:53:06 +02:00
a991740e00
server: improve API definition for messaging/messages/create
2022-10-26 22:21:28 +02:00
4dc97d5b65
server: enhance reset-password endpoint
...
- Add a rate limit analogous to request-reset-password.
See also a0ef32f4f6
.
- Delete an expired reset request if found.
- Return a proper error.
- Use time constants.
Changelog: Changed
2022-10-26 22:12:38 +02:00
384e8c49b7
server: allow to like own gallery posts
...
Since you are also allowed to react to your own notes, it seems sensible
that you should be allowed to like your own gallery posts.
Analogous to commit 4c5aa9e538
.
Changelog: Changed
2022-10-25 17:13:48 +02:00
Atsuko Karagi
c5e1c42d0a
backend: require authentification for fetch-rss
...
Changelog: Changed
2022-10-25 08:56:34 -04:00
Atsuko Karagi
f74395c386
backend: remove unused endpoints
...
Changelog: Removed
2022-10-25 08:56:31 -04:00
Atsuko Karagi
b2c483faf5
backend: tweak endpoint permissions
...
Changelog: Changed
2022-10-25 08:36:39 -04:00
Atsuko Karagi
5bf1e5ad71
backend: federation information requires auth
...
Changelog: Changed
2022-10-25 08:36:37 -04:00
a0ef32f4f6
server: properly delete expired password reset requests
...
Changelog: Fixed
2022-10-23 23:09:11 +02:00
7ec8729d90
backend: fix lint error in remove-note.ts
2022-10-21 17:52:15 -04:00
43644494d3
translate remaining comments
2022-10-21 13:33:03 -04:00
923c93da12
use await for notes.countBy
2022-10-20 21:22:52 -04:00
aa1e4d0fbc
change null assertion ternaries to use optional chaining
2022-10-20 21:22:52 -04:00
bfba54524d
backend: fix various type lints in services/note
...
`createdAt` in `insertNote` now will default to the current date.
Also refactor poll insert:
Instead of testing hasPoll, just do a null check on data.poll since it's
a more reliable indicator for whether a poll exists (and also tsc won't
complain about data.poll being possibly null).
2022-10-20 21:22:24 -04:00
d83c1c3851
backend: use named exports for services/note
2022-10-20 21:16:34 -04:00
3da7221eec
backend: mark elasticsearch as optional
2022-10-20 21:15:48 -04:00
9544cd69d2
fix typo
2022-10-20 21:26:12 +02:00
b359b01700
improve docs
2022-10-20 21:22:34 +02:00
cfb8723618
fix API definitions
2022-10-20 20:40:48 +02:00
ee70ad52fc
server: error when trying to unclip note that is not clipped
...
When a note is not added to a clip and an API call tries to remove the note
from that clip, the API will now raise an error.
Changelog: Changed
2022-10-19 21:54:37 +02:00
4c5aa9e538
server: allow to like own pages
...
Since you are also allowed to react to your own notes, it seems sensible
that you should be allowed to like your own pages.
Changelog: Changed
2022-10-19 21:52:43 +02:00
4b6c3b2f37
properly await promise
2022-10-19 15:26:37 +02:00
fbf7ea07c9
server refactor: centrally load locale
...
To reduce code duplication, the locales are loaded in @/misc/i18n.ts
directly instead of importing it in each file using it separately.
2022-10-19 12:30:23 +02:00
507dede6da
default to english instead of japanese
2022-10-19 09:25:38 +02:00
7257338077
backend: make max note length configurable ( #210 )
...
Changelog: Added
Closes: FoundKeyGang/FoundKey#208
Co-authored-by: Francis Dinh <normandy@biribiri.dev>
Reviewed-on: FoundKeyGang/FoundKey#210
2022-10-18 17:33:00 +00:00
3aa1d3bf97
backend: update DB_MAX_IMAGE_COMMENT_LENGTH
...
This was increased to 2048 characters in
186d693385
.
2022-10-17 17:49:48 -04:00
04d4dd323f
backend: use time constant in services/chart/index.ts
2022-10-16 18:22:18 -04:00
e814fdc7d1
backend: fix lints in services/drive
2022-10-16 18:20:20 -04:00
f2f547172e
backend: improve documentation of pin/update functions
2022-10-16 18:06:22 -04:00
f17485d8a2
backend: add type annotations to delete.ts
2022-10-16 17:14:30 -04:00
70eec26b74
bump versions in all package.json files
2022-10-16 11:46:12 -04:00
811d5cd0d7
Merge pull request 'deliver Delete activities to all known instances' ( #198 ) from deliver-delete-everyone into main
...
Reviewed-on: FoundKeyGang/FoundKey#198
2022-10-16 13:46:23 +00:00
d762143b89
backend: fixup missing deadTime and incorrect import
2022-10-16 09:32:01 -04:00
21c1e5c06c
backend: simplify suspended and dead queries
...
This should also have better latency due to being a single query.
Furthermore, it's no longer a linear scan, since host is indexed.
Would be cool to simplify it further to a single query for blocks also...
Why exactly are blocks not in the db?
2022-10-16 09:22:05 -04:00
91a4f38871
backend: add automatic dead instance detection
...
It works by having a day-long cache of
"when did we last successfully communicate with this instance?"
Anything over a specified threshold (1 month) will act as though the instance
is suspended - all outgoing jobs are dropped on processing.
The day-long cache is in place because the ordering is necessarily a
linear scan.
Once an instance comes back online, we will detect that is the case as soon as
we receive an activity from them (which will update the "last communicated at")
field.
Potential future TODOs:
* Improve the caching system, it's actually pretty inefficient as it is.
CacheBox with a call override?
* Think of ways to make it not-a-linear-scan, since the instances table can get
pretty big. It's around 4500 on toast cafe.
ChangeLog: Added
2022-10-16 12:16:04 +00:00
756ecbb1f7
fix type error
2022-10-16 04:20:11 +02:00
cb0b14ba2d
backend: allow to export only specific emoji
2022-10-12 01:49:53 +02:00
7cd11e7afd
fix function name
2022-10-11 21:26:20 +02:00
0b8fa2665c
use DISTINCT instead of GROUP BY
...
This should have better performance for large recordsets.
Ref: FoundKeyGang/FoundKey#198 (comment)
2022-10-11 20:15:59 +02:00
421b42d07d
backend: send delete activity to all known instances
...
closes FoundKeyGang/FoundKey#190
Changelog: Added
2022-10-11 19:32:26 +02:00
9a503273fb
Merge pull request 'refactor meta API endpoint' ( #196 ) from refactor/api/meta into main
2022-10-11 17:20:51 +00:00
20a6140e9a
Merge pull request 'backend: Cleanup prelude directory' ( #199 ) from backend-cleanup-prelude into main
...
Reviewed-on: FoundKeyGang/FoundKey#199
2022-10-11 14:47:40 +00:00
6d58d5ed3b
fixup: muted-renotes review round 1
2022-10-11 10:42:39 +00:00
897658c188
import publishUserEvent in mute renote APIs
2022-10-11 10:42:39 +00:00
590a8b98d9
fixup renoteMuting stream filter being overzealous
2022-10-11 10:42:39 +00:00
dd5100d124
add streaming events for renotemuting and blocking
2022-10-11 10:42:39 +00:00
3d9df839a5
add down-migration for renote mutes
2022-10-11 10:42:39 +00:00
c414f24a2c
feat: per-user renote muting
...
Changelog: Added
2022-10-11 10:42:39 +00:00
60600729df
backend: Fix import of sanitize-html
...
I'm not sure how it managed to work so far, but the function is the default
export, using the namespace like a function should not have worked,
maybe something under the hood was correcting it back
2022-10-11 10:41:50 +02:00
683b0cfa82
backend: remove unused prelude modules
...
Much of these modules are no longer used in the backend. They seem to be
from before the code was organized in packages.
2022-10-11 01:53:34 -04:00
c65559872b
backend: add missing return type annotation in array.ts
2022-10-11 01:51:17 -04:00
13a3581817
Merge branch 'refactor/use-null-coalesce-etc'
...
Reviewed-on: FoundKeyGang/FoundKey#195
2022-10-10 18:44:19 -04:00
808c43377e
refactor: use nullish coalescing & optional chaining
...
Changes several places to use the afforementioned constructs in favour of
ternary expressions.
2022-10-11 00:39:27 +02:00
8920eeb86a
ActivityPub: allow all known shared inboxes to be addressed
...
This is oriented on this paragraph from the AP spec:
> Additionally, if an object is addressed to the Public special collection,
> a server MAY deliver that object to all known sharedInbox endpoints
> on the network.
2022-10-11 00:27:43 +02:00
91c043689b
Merge pull request 'backend: Fix imports from weird paths' ( #192 ) from Michcio/FoundKey-0x7f:extensionless-imports into main
...
Reviewed-on: FoundKeyGang/FoundKey#192
2022-10-10 18:58:54 +00:00
30faeb73d2
backend: Fix type errors in genId
...
I checked on NodeJS locally and `Math.min` was coercing the Dates to numbers,
I'm just making it more obvious (to the typechecker as well)
2022-10-10 20:50:04 +02:00
dc510c6834
Fix imports from weird paths
...
These imports were breaking in TS error checking and VS Code, because
imports need to have an extension to be valid, apparently
2022-10-10 20:45:45 +02:00
a91bbed34e
Make it impossible to start initializing Vue before DOM exists
2022-10-10 14:22:48 -04:00
9022ab9f2a
backend: ignore detail parameter on meta endpoint
...
Also allow meta endpoint to be fetched via GET.
Changelog: Removed
2022-10-10 17:36:13 +02:00
c20352b22e
backend: update THRESHOLD constants to use time constants
2022-10-05 00:54:16 -04:00
9084864b34
backend: translate comments in const.ts
2022-10-05 00:52:52 -04:00