Commit Graph

10065 Commits (158369f367a4a29eb960a7489939c5e13c33dc0b)

Author SHA1 Message Date
multiple creatures 158369f367 Create `f_normalize` function to transform filter queries. Also make the FTS migration an actual migration to save new Monsterfork admins the headache. 2019-11-18 03:30:52 -06:00
multiple creatures f1230bb319 Migrate old whole-word filters to modified syntax (double quoted strings treated as whole-word). 2019-11-18 02:52:17 -06:00
multiple creatures 0d90c0f61a Only apply a user's string filters if they actually have any set (otherwise all posts will be filtered). 2019-11-18 02:19:09 -06:00
multiple creatures 54afd828c2 Split indexing Rake tasks to: `monsterfork:index_statuses` (reindex statuses that do not normalized text yet), `monsterfork:reindex_statuses` (reindex all statuses), and `monsterfork:reindex_media_desc` (reindex statuses with media descriptions). These tasks are only needed by admins setting up Monsterfork for the first time or if the normalization scheme has changed drastically. 2019-11-18 02:19:09 -06:00
multiple creatures 4d6e1aa81d Include media attachment descriptions in normalized text. 2019-11-18 02:19:09 -06:00
multiple creatures 20f5ced61d Remove context selector from filter view. 2019-11-18 02:19:09 -06:00
multiple creatures f76c29beee Remove unused and incompatable filter settings. These will be re-added in time as they're rewritten to use database-level filtering. 2019-11-18 02:19:09 -06:00
multiple creatures 82f2e265f1 Remove `FilterHelper` include from timeline APIs. 2019-11-18 02:19:09 -06:00
multiple creatures 90189b98ff Always skip `Formatter` cache when serializing ActivityPub representations of posts and accounts. 2019-11-18 02:19:09 -06:00
multiple creatures 5c535c021f Remove a duplicate callback to `update_normalized_text`. 2019-11-18 02:19:09 -06:00
multiple creatures b1e3ecd78f In ProcessMentionsService, `skip_notify` should be a keyword argument, not positional. 2019-11-18 02:19:09 -06:00
multiple creatures 9d4a4efa7a Add a new profile option to filter posts with undescribed media. At some point, figure out how to put this under Filters, even if it angers the MVC model gods. No gods, no masters. 2019-11-18 02:19:09 -06:00
multiple creatures afe4b6b6ad Users' filters are applied in the `Status` model. They can also now use regular expressions. 2019-11-18 02:19:09 -06:00
multiple creatures b1049bc149 When streaming posts to timelines, do not apply filters to the author's own posts. 2019-11-18 02:19:05 -06:00
multiple creatures 68fa5ca1b7 The streaming server can now apply users' regex filters before sending content to their timelines.`Ia PostgreSQL fthaghn`. 2019-11-17 20:50:05 -06:00
multiple creatures d9e6204cd6 Do away with the kludgy solution of applying users' filters from API controllers; we will do this in the `Status` model instead, and at the database level. 2019-11-17 19:11:45 -06:00
multiple creatures a5c518b1df Add `filter_undescribed` column to `accounts` table. 2019-11-17 19:11:35 -06:00
multiple creatures 1391f44188 Removed one too many `rescue`s. 2019-11-17 19:01:22 -06:00
multiple creatures f01f38d0ea Prefix zero-width space before lines with space characters to preserve their formatting on other servers. 2019-11-17 15:39:39 -06:00
multiple creatures 04165369fd Reduce Vitamin D intake. 2019-11-17 15:06:00 -06:00
multiple creatures c8244ef728 Remove duplicated code. 2019-11-17 14:58:56 -06:00
multiple creatures 389a817aad Use `after_save` instead of `after_create`/`after_update` where methods should be called every time an object is changed. 2019-11-17 14:57:46 -06:00
multiple creatures 81942defe9 Hardcoded disabling of `Formatter` cache in normalizer. 2019-11-17 14:22:33 -06:00
multiple creatures 86750fff3f Do not allow `Formatter` cache when normalizing text by default - fixes mentions formatting bug. 2019-11-17 05:44:02 -06:00
multiple creatures 81c2b3e240 When domain policies are created or updated, set the `processing` flag from the model instead of from the controller. 2019-11-17 03:10:27 -06:00
multiple creatures 5ab70ad962 In the indexer, skip destroyed `Status` objects. 2019-11-17 02:55:56 -06:00
multiple creatures 296ec59fc9 Do not try to update destroyed `Status` objects. 2019-11-17 02:51:56 -06:00
multiple creatures 46acfb7f3c Include all tags in normalized text. Deduplicate and move them to the front. 2019-11-16 22:57:49 -06:00
multiple creatures d463ce4fe7 In the index task, do not cache `Formatter` results. 2019-11-16 22:13:07 -06:00
multiple creatures 81a551791d When normalizing the text of local posts, skip `Formatter` cache (but allow the results to be cached) by default. 2019-11-16 22:12:31 -06:00
multiple creatures a5335d8bae Allow callers of `Formatter` methods to specify that formatting results should not be cached. 2019-11-16 22:09:29 -06:00
multiple creatures e02073f7da Correct typo. 2019-11-16 21:47:58 -06:00
multiple creatures 00bc2e6072 In the index task, mute the debug logger once per batch instead of once per iteation. 2019-11-16 21:16:15 -06:00
multiple creatures 9ab5a3fca4 Fix progress text. 2019-11-16 21:09:31 -06:00
multiple creatures 1132af1515 Moved to using a normalized text column for searches. Admins using an FTS-enabled version of Monsterfork will need to apply the migration from `dist/search.sql` then run `bundle exec rails monsterfork:index_statuses`. 2019-11-16 21:01:07 -06:00
multiple creatures 487c945d16 Searches now work on `following` scope. 2019-11-16 07:23:52 -06:00
multiple creatures 6abae51e47 Regular expressions can now be used in full-text searches. Wrapping a search term in double-quotes treats it as a whole-word match. 2019-11-16 07:17:15 -06:00
multiple creatures 9de5952f4e Update database queries to reflect change of search implementation. 2019-11-16 06:04:31 -06:00
multiple creatures 3b1aed6cf1 Update admin instructions to migrate from PostgreSQL FTS to trigram-based search. 2019-11-16 05:54:00 -06:00
multiple creatures b462b46a80 The WAS spammer detection is no longer needed; removing this code from the Janitor. 2019-11-16 05:41:17 -06:00
multiple creatures d13e73d498 fix missing `srem` argument in commit `d162ebae7` 2019-11-06 15:15:24 -06:00
multiple creatures d162ebae79 remove undeliverable flag from temporarily offline remote accounts & servers if something is successfully received from them 2019-11-06 02:12:37 -06:00
multiple creatures facde93c4d clear formatter cache when profile is changed 2019-11-06 00:44:37 -06:00
multiple creatures 0db4b0b9d5 perform spam detection at registration time 2019-11-06 00:08:06 -06:00
multiple creatures af9b9777af add profile option to (locally) block anonymous views of public posts 2019-10-27 14:02:05 -05:00
multiple creatures 50401161a5 whee db schema update 2019-10-27 13:47:05 -05:00
multiple creatures e80aed27b3 add `unboostable` boolean to account model in preparation for adding more types of moderation polices + allowing authors to make unboostable posts irrespective of scope 2019-10-27 13:45:21 -05:00
multiple creatures 33eda4098c add `force_private` boolean to account model in preparation for adding more types of moderation polices 2019-10-27 13:38:28 -05:00
multiple creatures 58c707c474 make data miners' lives harder by also requiring authentication on account api endpoints 2019-10-27 12:17:50 -05:00
multiple creatures 87e48598f2 fix breaking typos 2019-10-26 01:06:34 -05:00