PostgreSQL Source Code git master
|
Data Structures | |
class | Codepoint |
Functions | |
def | print_record (codepoint, letter) |
def | is_mark_to_remove (codepoint) |
def | is_plain_letter (codepoint) |
def | is_mark (codepoint) |
def | is_letter_with_marks (codepoint, table) |
def | is_letter (codepoint, table) |
def | get_plain_letter (codepoint, table) |
def | is_ligature (codepoint, table) |
def | get_plain_letters (codepoint, table) |
def | parse_cldr_latin_ascii_transliterator (latinAsciiFilePath) |
def | special_cases () |
def | main (args) |
Variables | |
stdout | |
tuple | PLAIN_LETTER_RANGES |
tuple | COMBINING_MARK_RANGES |
parser = argparse.ArgumentParser(description='This script builds unaccent.rules on standard output when given the contents of UnicodeData.txt and Latin-ASCII.xml given as arguments.') | |
help | |
type | |
str | |
required | |
True | |
dest | |
action | |
args = parser.parse_args() | |
def generate_unaccent_rules.get_plain_letter | ( | codepoint, | |
table | |||
) |
Return the base codepoint without marks. If this codepoint has more than one combining character, do a recursive lookup on the table to find out its plain base letter.
Definition at line 131 of file generate_unaccent_rules.py.
References get_plain_letter(), is_letter_with_marks(), is_plain_letter(), and len.
Referenced by get_plain_letter(), get_plain_letters(), and main().
def generate_unaccent_rules.get_plain_letters | ( | codepoint, | |
table | |||
) |
Return a list of plain letters from a ligature.
Definition at line 154 of file generate_unaccent_rules.py.
References assert, get_plain_letter(), and is_ligature().
Referenced by main().
def generate_unaccent_rules.is_letter | ( | codepoint, | |
table | |||
) |
Return true for letter with or without diacritical marks.
Definition at line 126 of file generate_unaccent_rules.py.
References is_letter_with_marks(), and is_plain_letter().
Referenced by is_ligature().
def generate_unaccent_rules.is_letter_with_marks | ( | codepoint, | |
table | |||
) |
Returns true for letters combined with one or more marks.
Definition at line 103 of file generate_unaccent_rules.py.
References is_letter_with_marks(), is_mark(), is_plain_letter(), and len.
Referenced by get_plain_letter(), is_letter(), is_letter_with_marks(), and main().
def generate_unaccent_rules.is_ligature | ( | codepoint, | |
table | |||
) |
Return true for letters combined with letters.
Definition at line 150 of file generate_unaccent_rules.py.
References is_letter().
Referenced by get_plain_letters(), and main().
def generate_unaccent_rules.is_mark | ( | codepoint | ) |
Returns true for diacritical marks (combining codepoints).
Definition at line 98 of file generate_unaccent_rules.py.
Referenced by is_letter_with_marks(), and is_mark_to_remove().
def generate_unaccent_rules.is_mark_to_remove | ( | codepoint | ) |
Return true if this is a combining mark to remove.
Definition at line 79 of file generate_unaccent_rules.py.
References is_mark().
Referenced by main().
def generate_unaccent_rules.is_plain_letter | ( | codepoint | ) |
Return true if codepoint represents a "plain letter".
Definition at line 90 of file generate_unaccent_rules.py.
Referenced by get_plain_letter(), is_letter(), and is_letter_with_marks().
def generate_unaccent_rules.main | ( | args | ) |
Definition at line 228 of file generate_unaccent_rules.py.
References get_plain_letter(), get_plain_letters(), is_letter_with_marks(), is_ligature(), is_mark_to_remove(), len, parse_cldr_latin_ascii_transliterator(), print_record(), and special_cases().
def generate_unaccent_rules.parse_cldr_latin_ascii_transliterator | ( | latinAsciiFilePath | ) |
Parse the XML file and return a set of tuples (src, trg), where "src" is the original character and "trg" the substitute.
Definition at line 160 of file generate_unaccent_rules.py.
Referenced by main().
def generate_unaccent_rules.print_record | ( | codepoint, | |
letter | |||
) |
Definition at line 59 of file generate_unaccent_rules.py.
References print().
Referenced by main().
def generate_unaccent_rules.special_cases | ( | ) |
Returns the special cases which are not handled by other methods
Definition at line 213 of file generate_unaccent_rules.py.
Referenced by main().
generate_unaccent_rules.action |
Definition at line 287 of file generate_unaccent_rules.py.
Referenced by action_to_str(), apply_dispatch(), audit_attempt(), audit_failure(), audit_success(), brin_xlog_desummarize_page(), brin_xlog_insert_update(), brin_xlog_revmap_extend(), brin_xlog_samepage_update(), brin_xlog_update(), check_foreign_key(), computeLeafRecompressWALData(), DefineQueryRewrite(), emit_audit_message(), error_view_not_updatable(), ExecAlterDefaultPrivilegesStmt(), ExecInitMerge(), ExecInitPartitionInfo(), ExecMergeNotMatched(), ExecSetVariableStmt(), expression_tree_mutator_impl(), expression_tree_walker_impl(), fmgr_security_definer(), generic_redo(), get_merge_query_def(), gistRedoClearFollowRight(), grouping_planner(), handle_streamed_transaction(), hash_search(), hash_search_with_hash_value(), hash_xlog_delete(), hash_xlog_move_page_contents(), hash_xlog_split_allocate_page(), hash_xlog_split_complete(), hash_xlog_squeeze_page(), hash_xlog_vacuum_one_page(), heap_xlog_insert(), heap_xlog_multi_insert(), heap_xlog_prune_freeze(), heap_xlog_visible(), index_set_state_flags(), injection_points_attach(), InsertRule(), iterate_json_values(), iterate_jsonb_values(), logicalrep_message_type(), logicalrep_read_delete(), logicalrep_read_insert(), logicalrep_read_update(), make_ruledef(), parseCreateReplSlotOptions(), perform_pullup_replace_vars(), pgoutput_change(), pgoutput_row_filter(), preprocess_targetlist(), ProcessGUCArray(), push_old_value(), queue_listen(), register_on_commit_action(), REGRESS_utility_command(), RewriteQuery(), rewriteTargetView(), set_config_option(), set_config_option_ext(), set_config_with_handle(), set_plan_refs(), simple_action_list_append(), spgRedoAddLeaf(), spgRedoAddNode(), spgRedoMoveLeafs(), spgRedoPickSplit(), spgRedoSplitTuple(), stream_open_and_write_change(), stream_write_change(), subquery_planner(), transform_MERGE_to_join(), transformMergeStmt(), transformRuleStmt(), ts_headline_json_byid_opt(), ts_headline_jsonb_byid_opt(), view_has_instead_trigger(), and walkdir().
generate_unaccent_rules.args = parser.parse_args() |
Definition at line 288 of file generate_unaccent_rules.py.
Referenced by _int_matchsel(), _jumbleVariableSetStmt(), _outBoolExpr(), _readBoolExpr(), add_function_defaults(), ahprintf(), appendJSONKeyValueFmt(), appendPQExpBuffer(), appendPQExpBufferVA(), appendStringInfo(), appendStringInfoVA(), archprintf(), array_unnest_support(), arraycontsel(), autoinc(), build_aggregate_deserialfn_expr(), build_aggregate_finalfn_expr(), build_aggregate_serialfn_expr(), build_aggregate_transfn_expr(), build_coercion_expression(), cat_str(), check_agg_arguments(), check_agglevels_and_constraints(), check_foreign_key(), check_hashjoinable(), check_memoizable(), check_mergejoinable(), check_primary_key(), clause_selectivity_ext(), clauselist_selectivity_ext(), coerce_record_to_complex(), count_rowexpr_columns(), CreateTriggerFiringOn(), decrypt_internal(), DefineAggregate(), do_copy(), does_not_exist_skipping(), dopr(), ecpg_do(), ecpg_do_prologue(), ECPGdescribe(), ECPGdo(), ECPGget_desc(), ECPGset_desc(), encrypt_internal(), eqjoinsel(), eqsel_internal(), error(), eval_const_expressions_mutator(), evalFunc(), evalLazyFunc(), evalStandardFunc(), evaluate_function(), examine_opclause_args(), ExecEvalFuncExprStrictFusage(), ExecInitExprRec(), ExecInitFunc(), ExecInterpExpr(), ExecJustApplyFuncToCase(), executeQueryOrDie(), expand_function_arguments(), expression_tree_walker_impl(), extract_variadic_args(), find_arguments(), find_duplicate_ors(), find_single_rel_for_clauses(), flatten_set_variable_args(), FuncnameGetCandidates(), function_selectivity(), gen_partprune_steps_internal(), generate_series_int4_support(), generate_series_int8_support(), generate_series_numeric_support(), generate_series_timestamp_support(), generic_restriction_selectivity(), get_call_expr_arg_stable(), get_call_expr_argtype(), get_from_clause_item(), get_join_variables(), get_notclausearg(), get_oper_expr(), get_qual_for_hash(), get_restriction_variable(), get_rule_expr(), get_simple_binary_op_name(), getopt_long(), group_similar_or_args(), info_cb(), init_work(), inline_function(), insert_username(), isSimpleNode(), join_selectivity(), json_build_array(), json_build_array_worker(), json_build_object(), json_build_object_worker(), jsonb_build_array(), jsonb_build_array_worker(), jsonb_build_object(), jsonb_build_object_worker(), JsonTableInitOpaque(), JsonTableInitPlan(), libpq_append_conn_error(), libpq_append_error(), lo_manage(), ltreeparentsel(), make_bitmap_paths_for_or_group(), make_jsp_entry_node(), make_jsp_expr_node(), make_jsp_expr_node_args(), make_op(), make_plain_restrictinfo(), make_scalar_array_op(), make_sub_restrictinfos(), makeBoolExpr(), makeFuncCall(), makeFuncExpr(), makeJsonConstructorExpr(), match_clause_to_partition_key(), matchingsel(), moddatetime(), multirangesel(), neqjoinsel(), networkjoinsel(), networksel(), parallel_exec_prog(), parse_args(), parse_slash_copy(), patternsel(), patternsel_common(), pg_fatal(), pg_fprintf(), pg_get_object_address(), pg_get_ruledef_worker(), pg_get_viewdef_worker(), pg_identify_object_as_address(), pg_log(), pg_printf(), pg_snprintf(), pg_sprintf(), pg_vfprintf(), pg_vprintf(), pg_vsnprintf(), pg_vsprintf(), PLy_cursor(), PLy_cursor_fetch(), PLy_cursor_plan(), PLy_debug(), PLy_error(), PLy_exception_set_with_details(), PLy_fatal(), PLy_function_build_args(), PLy_info(), PLy_log(), PLy_notice(), PLy_output(), PLy_plan_cursor(), PLy_plan_execute(), PLy_plan_status(), PLy_quote_ident(), PLy_quote_literal(), PLy_quote_nullable(), PLy_spi_exception_set(), PLy_spi_execute(), PLy_spi_prepare(), PLy_subtransaction_exit(), PLy_warning(), PQfn(), pqFunctionCall3(), pqInternalNotice(), prep_status(), prep_status_progress(), printfPQExpBuffer(), process_sublinks_mutator(), processTypesSpec(), psprintf(), psql_add_command(), pull_ands(), pull_ors(), pull_up_sublinks_qual_recurse(), pvsnprintf(), rangesel(), raw_expression_tree_walker_impl(), recheck_cast_function_args(), reorder_function_arguments(), report_invalid_record(), report_status(), restriction_selectivity(), scalararraysel(), scalarineqsel_wrapper(), SetPGVariable(), SetWALFileNameForCleanup(), simplify_and_arguments(), simplify_boolean_equality(), simplify_function(), simplify_or_arguments(), stats_fill_fcinfo_from_arg_pairs(), substitute_actual_parameters(), substitute_actual_srf_parameters(), tarPrintf(), test_support_func(), testexpr_is_hashable(), transformAExprBetween(), transformAExprIn(), transformAExprOp(), transformAggregateCall(), transformBoolExpr(), transformCoalesceExpr(), transformFuncCall(), transformGroupingFunc(), transformJsonAggConstructor(), transformJsonArrayConstructor(), transformJsonConstructorOutput(), transformJsonObjectAgg(), transformJsonObjectConstructor(), transformJsonPassingArgs(), transformMinMaxExpr(), tsmatchsel(), ttdummy(), verror(), warning(), and xmlconcat().
tuple generate_unaccent_rules.COMBINING_MARK_RANGES |
Definition at line 54 of file generate_unaccent_rules.py.
generate_unaccent_rules.dest |
Definition at line 285 of file generate_unaccent_rules.py.
Referenced by _SPI_cursor_operation(), _SPI_execute_plan(), add_pos(), AppendInvalidationMessages(), AppendInvalidationMessageSubGroup(), ArrayCastAndSet(), ascii_safe_strlcpy(), begin_tup_output_tupdesc(), BeginCopyTo(), big5_to_euc_tw(), big5_to_mic(), big5_to_utf8(), brin_copy_tuple(), compute_scalar_stats(), copy_file_by_range(), copy_file_clone(), copy_generic_path_info(), copy_key(), copy_plan_costsize(), CopyReadBinaryData(), CreateDestReceiver(), CreateQueryDesc(), CreateReplicationSlot(), DoPortalRunFetch(), dshash_memcpy(), dshash_strcpy(), EndCommand(), euc_cn_to_mic(), euc_cn_to_utf8(), euc_jis_2004_to_shift_jis_2004(), euc_jis_2004_to_utf8(), euc_jp_to_mic(), euc_jp_to_sjis(), euc_jp_to_utf8(), euc_kr_to_mic(), euc_kr_to_utf8(), euc_tw_to_big5(), euc_tw_to_mic(), euc_tw_to_utf8(), exec_execute_message(), exec_replication_command(), exec_simple_query(), ExecCreateTableAs(), execute_sql_string(), ExecuteCallStmt(), ExecutePlan(), ExecuteQuery(), ExplainOnePlan(), ExplainQuery(), from_char_parse_int(), from_char_parse_int_len(), from_char_seq_search(), from_char_set_int(), FullTransactionIdAdvance(), FullTransactionIdRetreat(), gb18030_to_utf8(), gbk_to_utf8(), GetPGVariable(), GetPublicationsStr(), GetSerializationMetrics(), hashline_number(), heap_copytuple_with_tuple(), IdentifySystem(), init_var_from_num(), iso8859_1_to_utf8(), iso8859_to_utf8(), iso_to_koi8r(), iso_to_mic(), iso_to_win1251(), iso_to_win866(), johab_to_utf8(), koi8r_to_iso(), koi8r_to_mic(), koi8r_to_utf8(), koi8r_to_win1251(), koi8r_to_win866(), koi8u_to_utf8(), latin1_to_mic(), latin2_to_mic(), latin2_to_win1250(), latin3_to_mic(), latin4_to_mic(), ldchar(), LookupWSErrorMessage(), mbstowcs_l(), mic_to_big5(), mic_to_euc_cn(), mic_to_euc_jp(), mic_to_euc_kr(), mic_to_euc_tw(), mic_to_iso(), mic_to_koi8r(), mic_to_latin1(), mic_to_latin2(), mic_to_latin3(), mic_to_latin4(), mic_to_sjis(), mic_to_win1250(), mic_to_win1251(), mic_to_win866(), NullCommand(), partition_bounds_copy(), PerformPortalFetch(), pg_cryptohash_final(), pg_do_encoding_conversion_buf(), pg_hmac_final(), pg_md5_final(), pg_sha1_final(), pg_strnxfrm(), pg_strnxfrm_prefix(), pg_strxfrm(), pg_strxfrm_prefix(), pg_to_ascii(), pglz_compress(), pglz_decompress(), pgss_ProcessUtility(), PortalRun(), PortalRunFetch(), PortalRunMulti(), PortalRunSelect(), PortalRunUtility(), postquel_start(), PQcopyResult(), printtup_create_DR(), process_pipe_input(), ProcessQuery(), ProcessUtility(), rbt_copy_data(), read_gucstate_binary(), ReadReplicationSlot(), ReadyForQuery(), refresh_matview_datafill(), RefreshMatViewByOid(), REGRESS_utility_command(), RunFromStore(), SendTablespaceList(), SendTimeLineHistory(), SendXlogRecPtrResult(), sepgsql_utility_command(), SerializePendingSyncs(), set_input(), set_var_from_non_decimal_integer_str(), set_var_from_num(), set_var_from_str(), set_var_from_var(), shift_jis_2004_to_euc_jis_2004(), shift_jis_2004_to_utf8(), ShowAllGUCConfig(), ShowGUCConfigOption(), sjis_to_euc_jp(), sjis_to_mic(), sjis_to_utf8(), SnapBuildRestoreContents(), standard_ExecutorRun(), standard_ProcessUtility(), StartReplication(), store_coded_char(), str_numth(), strlower_builtin(), strlower_libc_mb(), strlower_libc_sb(), strnxfrm_libc(), strtitle_builtin(), strtitle_libc_mb(), strtitle_libc_sb(), strupper_builtin(), strupper_libc_mb(), strupper_libc_sb(), uhc_to_utf8(), utf8_to_big5(), utf8_to_euc_cn(), utf8_to_euc_jis_2004(), utf8_to_euc_jp(), utf8_to_euc_kr(), utf8_to_euc_tw(), utf8_to_gb18030(), utf8_to_gbk(), utf8_to_iso8859(), utf8_to_iso8859_1(), utf8_to_johab(), utf8_to_koi8r(), utf8_to_koi8u(), utf8_to_shift_jis_2004(), utf8_to_sjis(), utf8_to_uhc(), utf8_to_win(), wcstombs_l(), win1250_to_latin2(), win1250_to_mic(), win1251_to_iso(), win1251_to_koi8r(), win1251_to_mic(), win1251_to_win866(), win866_to_iso(), win866_to_koi8r(), win866_to_mic(), win866_to_win1251(), win_to_utf8(), write_pipe_chunks(), and XLogCompressBackupBlock().
generate_unaccent_rules.help | ( | void | ) |
Definition at line 285 of file generate_unaccent_rules.py.
Referenced by helpSQL().
generate_unaccent_rules.parser = argparse.ArgumentParser(description='This script builds unaccent.rules on standard output when given the contents of UnicodeData.txt and Latin-ASCII.xml given as arguments.') |
Definition at line 284 of file generate_unaccent_rules.py.
tuple generate_unaccent_rules.PLAIN_LETTER_RANGES |
Definition at line 41 of file generate_unaccent_rules.py.
generate_unaccent_rules.required |
Definition at line 285 of file generate_unaccent_rules.py.
Referenced by _bt_advance_array_keys(), check_relation_privileges(), check_schema_perms(), sepgsql_avc_check_perms(), sepgsql_avc_check_perms_label(), sepgsql_dml_privileges(), sepgsql_proc_post_create(), sepgsql_proc_setattr(), and socket_putmessage_noblock().
generate_unaccent_rules.stdout |
Definition at line 35 of file generate_unaccent_rules.py.
Referenced by _allocAH(), BeginCopyTo(), bootstrap_template1(), check_ok(), ClosePager(), cluster_all_databases(), create_data_directory(), create_xlog_or_symlink(), CreateBackupStreamer(), DebugFileOpen(), diag2(), diag3(), diag4(), do_copy(), do_watch(), echo_hidden_command(), emit_tap_output_v(), exec_command_echo(), exec_command_print(), exec_command_prompt(), exec_command_sf_sv(), exec_prog(), ExecQueryAndProcessResults(), ExecQueryTuples(), geqo(), get_su_pwd(), gets_interactive(), handleCopyIn(), helpSQL(), InitArchiveFmt_Custom(), InitArchiveFmt_Tar(), initialize_data_directory(), InteractiveBackend(), IsPagerNeeded(), log_pre_callback(), main(), MainLoop(), openQueryOutputFile(), PageOutput(), parseCommandLine(), perform_spin_delay(), pg_log_generic_v(), pg_log_v(), pg_printf(), pg_regcomp(), pg_regexec(), pg_vprintf(), plpgsql_dumptree(), pprint(), PQdisplayTuples(), PQprint(), print(), print_aligned_text(), print_aligned_vertical(), print_filemap(), print_msg(), printResultSet(), printVersion(), PSQLexec(), reindex_all_databases(), run_permutation(), SendQuery(), set_option(), SetOutput(), setQFout(), setup_config(), sql_exec(), startup_hacks(), StreamLogicalLog(), SysLogger_Start(), test_config_settings(), test_file_descriptor_sync(), test_non_sync(), test_open_sync(), test_pipelined_insert(), test_sync(), vacuum_one_database(), vacuumlo(), and writezone().
generate_unaccent_rules.str |
Definition at line 285 of file generate_unaccent_rules.py.
generate_unaccent_rules.True |
Definition at line 285 of file generate_unaccent_rules.py.
generate_unaccent_rules.type |
Definition at line 285 of file generate_unaccent_rules.py.