Commit Graph

1274 Commits

Author SHA1 Message Date
Przemyslaw Czerpak
a44e171cc2 2012-05-16 19:23 UTC+0200 Przemyslaw Czerpak (druzus/at/poczta.onet.pl)
* harbour/src/vm/classes.c
    % small optimization in __CLSGetProperties() function

  * harbour/src/rtl/tpersist.prg
    ! force linkin ARRAY() function when HBPersistent class is used
    ! use hb_ValToExp() instead of local ValToText() function which
      didn't work correctly for memos and some other types
    ! fixed infinite loop in HBPersistent:LoadFromText() used with
      empty text. The problem was also exploited by :LoadFromFile()
      method if file does not exists or it's empty()
    ! fixed deserialization of strings containing "=" char inside
    ! fixed deserialization of strings containing "::"
    ! added support for decoding nested objects - the code was not
      finished and this part was not implemented at all
    + added support for serialized text using ":=" assign operator
      instead of "="
    * use ":=" instead of "=" as assign operator in new serialized
      text
    + ignore lines starting with "//" and added support for files
      which do not start with OBJECT directive
    * ignore pointer and codeblock items stored in instance variables
      during serialization
    ; now HBPersistent class in Harbour should read serialized files
      created in xHarbour with few exceptions:
         - Harbour does not allow to serialize codeblocks
           See "CODEBLOCK SERIALIZATION / DESERIALIZATION" in
           doc/xhb-diff.txt for the reasons.
           If Harbour application restores xHarbour HBPersistent files
           with serialized codeblocks then RTE
               Undefined function: HB_RESTOREBLOCK
           is generated.
         - xHarbour serialize pointer items as numeric items
           saved in hexadecimal notation. Then restore them as numbers.
         - HBPersistent does not support hash arrays - they are
           serialized by default serialization code used by both
           compilers to generate expressions.
           In Harbour it's done by hb_valToExp() function and
           in xHarbour it's ValToPrg() is used.
           ValToPrg() does not create valid macrocompiler expressions
           for arrays and objects so HBPersistent files created
           by xHarbour are broken and cannot be correctly deserialized.
           It happens if objects has hash arrays in instance variables
           and these hash arrays contain normal arrays or object
           If Harbour application restores such xHarbour HBPersistent
           file then RTE "Syntax error: &" is generated.
    ; xHarbour encapsulates deserialization code inside TRY/CATCH/END
      statement saving errors to trace.log file. Harbour generates RTE.
      If programmer needs similar behavior then he should
      call :LoadFromText() and :LoadFromFile() methods inside
      BEGIN SEQUENCE [ / RECOVER ... ] / END SEQUENCE
      statement.
    ; xHarbour reinitialize all or properties instance variables to
      default state inside :LoadFromText() and :LoadFromFile() methods.
      The 3-rd parameter in above method <lPropertiesOnly> allows to
      chose which install variables should be reinitialized:
      all (default) or properties only.
      Harbour does not have such functionality.
      If programmer needs it then he should reinitialize them himself.
      It can be easy done be simple function.
      Alternatively we can implement this functionality but in such
      case I'd suggest to define three actions for such switch:
         none (default), all, properties only.
    ; Harbour does not support 2-nd parameter <lIgnoreBadIVars> which
      exist in xHarbour versions of HBPersistent:LoadFromText() and
      HBPersistent:LoadFromFile():
      If necessary we can implement it though it's usable only if we
      want to ignore some wrong lines and process others.
    ; Warning: Neither Harbour nor xHarbour supports arrays and objects
               with cyclic references in HBPersistent code - infinite
               loop appears in such case.
    ; I've never used HBPersistent and the state of the previous
      HBPersistent code in Harbour suggests that no one used it for
      some serious jobs so I'm open for any opinions and suggestions
      about it from xHarbour users.

  * harbour/src/compiler/harbour.y
    * generate line numbers before extended codeblocks - it gives
      more debugger friendly code.

  * harbour/src/compiler/harbour.yyh
  * harbour/src/compiler/harbour.yyc
    * regenerated (with bison 2.4.1)
2012-05-16 17:23:20 +00:00
Viktor Szakats
f71c4e0a25 2012-05-16 18:38 UTC+0200 Viktor Szakats (harbour syenar.net)
* src/rtl/hbgtcore.c
  * src/rtl/rat.c
  * src/codepage/cp_utf8.c
    % deleted unnecessary assignment generating warnings with 
      some compilers
2012-05-16 16:39:24 +00:00
Viktor Szakats
11eecc403b 2012-05-16 18:28 UTC+0200 Viktor Szakats (harbour syenar.net)
* src/vm/set.c
    ! added missing '#include "hbvm.h"' for hb_vmIsReady()
2012-05-16 16:28:42 +00:00
Viktor Szakats
a802e03e10 2012-05-15 13:20 UTC+0200 Viktor Szakats (harbour syenar.net)
* src/common/hbgete.c
    ! fix to prev. test and review pls. BTW, the solution is 
      on google, so you can redo it too:
         https://issues.apache.org/jira/browse/STDCXX-358
2012-05-15 11:23:01 +00:00
Viktor Szakats
d2a1b36d05 2012-05-15 13:05 UTC+0200 Viktor Szakats (harbour syenar.net)
* src/common/hbgete.c
    ! fixed unsetenv() usage for older Darwin versions (f.e. Tiger)
      (please test)
2012-05-15 11:06:50 +00:00
Viktor Szakats
9d1552d1cc 2012-05-09 16:14 UTC+0200 Viktor Szakats (harbour syenar.net)
* src/common/hbdate.c
    ! hb_dateStrPut() fixed to never put non-digits in the
      result. F.e. in this case: ? 0d19700101 + 1100000000
2012-05-09 14:15:50 +00:00
Przemyslaw Czerpak
6f27c78569 2012-05-08 12:28 UTC+0200 Przemyslaw Czerpak (druzus/at/poczta.onet.pl)
* harbour/src/common/expropt2.c
    * small code simplification

  * harbour/src/rtl/hbregex.c
    % eliminated call to pcre_config() on each regex compilation

  * harbour/utils/hbmk2/hbmk2.prg
    ! fixed -head=full for code using non UTF8 characters.
      It was broken because in UNIX builds UTF8 is always enabled
      as HVM CP in HBMK2 and this setting was inherited by PCRE
      with PCRE_UTF8 flag. If this flag is used PCRE validates
      all strings and refuse to make any operations if they are
      not valid UTF8 string so it was not working at all for
      source code using different encoding.
    ! fixed regex used in -head=full to respect shortcuts in #include
      directive, i.e.:
         #incl "file.ch"
    ! fixed regex used in -head=full to recognize #include directives
      separated by ';', i.e.:
         #include "file1.ch" ; #include "file2.ch" ; #include "file3.ch"
    ; TOFIX: UTF8 mode on output should not be enabled unconditionally in
             all UNIX builds. There are many *nix installations where UTF8
             is not system CP, i.e. older Linux distributions. In fact
             it's user attribute so each user can use different encoding
             local to his connection and/or terminal settings. Probably
             it's good idea to use code like:
                  lUTF8 := "UTF-8" $ GetEnv( "LANG" ) .OR. ;
                           "UTF-8" $ GetEnv( "LC_CTYPE" )
2012-05-08 10:28:46 +00:00
Viktor Szakats
ddd8ef46bc 2012-05-04 20:07 UTC+0200 Viktor Szakats (harbour syenar.net)
* utils/hbmk2/hbmk2.prg
    ! fixed RTE when logging sign command
    ! fixed `` operator to strip CRs and convert LFs to space
      in stdout output.

  * src/rdd/dbcmd.c
    ! clarified DBCREATE() 4th parameter in comment
2012-05-04 18:09:22 +00:00
Viktor Szakats
1be0971119 2012-05-04 01:51 UTC+0200 Viktor Szakats (harbour syenar.net)
* include/harbour.hbx
  * src/rtl/cdpapihb.c
    + HB_CDPCHARMAX( [<cCP>] ) -> <nMaxCharCode>
      (ATM 0xFFFF for unicode or 0xFF for non-unicode (default) CPs)
2012-05-03 23:53:24 +00:00
Viktor Szakats
1721eee814 2012-05-04 01:12 UTC+0200 Viktor Szakats (harbour syenar.net)
* src/rtl/hbstrsh.c
    + HB_STRSHRINK() updated to work on custom character indexes (UTF8)
2012-05-03 23:12:49 +00:00
Viktor Szakats
ad79a430f7 2012-05-02 12:30 UTC+0200 Viktor Szakats (harbour syenar.net)
* include/hbcompdf.h
  * include/hbexprop.h
  * include/hbexprb.c
  * src/common/funcid.c
  * src/common/expropt2.c
    + added compile-time optimization for HB_BCHAR()
      and HB_BCODE().

  * contrib/hbct/hbct.hbp
  * contrib/hbct/hbct.hbx
  + contrib/hbct/ctscan.ch
  + contrib/hbct/kxlat.prg
  * contrib/hbct/ctdummy.prg
  * contrib/hbct/dummy.c
    + added CT compatiblity functions: SETKXLAT(), GETKXLAT(),
      SETKXTAB(), GETKXTAB(). Former two replaces existing
      dummy implementations. Check CT documentation for syntax.
      NOTES: - KS_PAD[0-9] and KS_PAD_DECIMAL are not supported in
               Harbour, because they have no corresponding inkey.ch
               value.
             - Harbour uses HB_GTI_INKEYFILTER to implement these
               functions, and due to this, they will gracefully
               fail if the application has already set
               HB_GTI_INKEYFILTER to a custom value.
    + added:
         HBCT_GETKXLAT( <nOrgKey>[, <nNewKey> ] ) -> <lAccepted>
         HBCT_GETKXTAB( <nOrgKey> ) -> <nNewKey>
         HBCT_SETKXLAT( <hTrs> ) -> <lAccepted>
         HBCT_SETKXTAB() -> <hTrs>
      Same as above, but they use standard inkey() values.
    ; USE AT YOUR OWN RISK. NO GUARANTEES.

  * contrib/hbct/showtime.prg
  * contrib/hbct/screen2.c
    * internal fn renamed: _HB_CTDSPTIME() -> __HBCT_DSPTIME()
2012-05-02 10:32:45 +00:00
Viktor Szakats
c123a1cb21 2012-05-01 20:50 UTC+0200 Viktor Szakats (harbour syenar.net)
* src/rtl/hbregex.c
    % deleted unnecessary protection around PCRE_CONFIG_UTF8
      macro usage. (it was used unprotected elsewhere in the 
      code for a long time)

  * INSTALL
    + added mingw64 on win64 host example. (same as on win32,
      except comment)
2012-05-01 18:52:03 +00:00
Viktor Szakats
4876c762bb 2012-04-27 12:08 UTC+0200 Viktor Szakats (harbour syenar.net)
* src/rtl/cdpapihb.c
    % HB_UTF8TOSTR()/HB_STRTOUTF8() optimized to "fall through"
      if the HVM CP is UTF8. Check me.

  * utils/hbmk2/hbmk2.prg
    ! TOFIX removed from two FOR EACH loops, they work on ASCII chars only
    ! one FOR EACH loop conditionally converted to FOR NEXT to work with all CPs
    ! one FOR EACH loop converted to FOR NEXT and to work on binary data
    ! Changed certain function calls to hb_ascii*() prefixed versions
    ! fixed .hbx generator to work with accented filenames
2012-04-27 10:08:33 +00:00
Przemyslaw Czerpak
4c2b14b6a3 2012-04-26 17:01 UTC+0200 Przemyslaw Czerpak (druzus/at/poczta.onet.pl)
* harbour/src/rtl/gtstd/gtstd.c
  * harbour/src/rtl/gttrm/gttrm.c
  * harbour/src/rtl/gtsln/gtsln.c
  * harbour/src/rtl/gtpca/gtpca.c
    ! do not redirect STDERR to screen buffer if default screen
      output is not redirected to console/tty device
2012-04-26 15:01:52 +00:00
Przemyslaw Czerpak
c9e8816417 2012-04-26 10:35 UTC+0200 Przemyslaw Czerpak (druzus/at/poczta.onet.pl)
* harbour/src/rtl/hbgtcore.c
    ! fixed typo in OUTSTD() handler - thanks to Mindaugas
      for locating the problem.
2012-04-26 08:35:40 +00:00
Viktor Szakats
3343571ea7 2012-04-25 16:16 UTC+0200 Viktor Szakats (harbour syenar.net)
* include/harbour.hbx
  * src/rtl/cdpapihb.c
    + added HB_CDPISUTF8( <cCDPID> ) -> <lResult>
2012-04-25 14:17:00 +00:00
Przemyslaw Czerpak
5f6a55b505 2012-04-25 11:41 UTC+0200 Przemyslaw Czerpak (druzus/at/poczta.onet.pl)
* harbour/include/harbour.hbx
  * harbour/src/rtl/chruni.c
    + added HB_ULEFT(), HB_BLEFT(), HB_URIGHT(), HB_BRIGHT()
2012-04-25 09:41:47 +00:00
Viktor Szakats
83cc2881dd 2012-04-25 02:20 UTC+0200 Viktor Szakats (harbour syenar.net)
* include/harbour.hbx
  * src/rtl/inkey.c
    + added HB_KEYCODE( <cChar> ) -> <nExtKey>
    ; pls review me. It helps replacing ASC() calls in unicode apps
      where it's used to convert characters (f.e. hotkeys) to keyboard
      codes.
2012-04-25 00:21:07 +00:00
Przemyslaw Czerpak
0aeb0d3cae 2012-04-24 17:34 UTC+0200 Przemyslaw Czerpak (druzus/at/poczta.onet.pl)
* harbour/include/harbour.hbx
  * harbour/src/rtl/chruni.c
    + added HB_BSUBSTR() and HB_USUBSTR()
2012-04-24 15:34:32 +00:00
Przemyslaw Czerpak
5d2675146a 2012-04-24 16:20 UTC+0200 Przemyslaw Czerpak (druzus/at/poczta.onet.pl)
* harbour/include/hbapilng.h
  * harbour/src/vm/hvm.c
  * harbour/src/rtl/langapi.c
  * harbour/include/harbour.hbx
    + added new PRG function:
         HB_LANGNEW( <cNewLangId>, <cNewLangCpId>,
                     <cLangId>, <cLangCpId> ) -> <lOK>
      this function dynamically creates new lang module translating
      existing one then registers it, i.e.:
         request HB_CODEPAGE_DE850
         request HB_CODEPAGE_DEISO
         request HB_LANG_DE
         HB_LANGNEW( "DEISO", "DEISO", "DE", "DE850" )
         SET( _SET_LANGUAGE, "DEISO" )

  * harbour/src/rtl/cdpapi.c
    * changed dynamic buffer for "EN" CP translations and flags
      to static one - it allows to use this CP after hb_cdpReleaseAll()
2012-04-24 14:20:40 +00:00
Przemyslaw Czerpak
290ae1b594 2012-04-24 10:25 UTC+0200 Przemyslaw Czerpak (druzus/at/poczta.onet.pl)
* harbour/src/vm/cmdarg.c
    ! respect HB_ARGSHIFT( .T. ) in windows version of hb_cmdargProgName()

  * harbour/ChangeLog
    ! fixed some typos in my unicode ChangeLog entry
2012-04-24 08:25:20 +00:00
Przemyslaw Czerpak
bc5cfa6b3c 2012-04-24 08:43 UTC+0200 Przemyslaw Czerpak (druzus/at/poczta.onet.pl)
* harbour/src/rtl/inkey.c
    * modified HB_KEYPUT() and HB_KEYINS() to convert strings
      into key codes instead of passing them directly to keyboard
      buffer like in __KEYBOARD() function.

  * harbour/include/hbgtcore.h
  * harbour/src/rtl/hbgtcore.c
    * modified hb_inkeySetText() (PRG __KEYBOARD() function) to translate
      passed string into unicode values
      This modification affects also HB_GTI_CLIPBOARDPASTE
2012-04-24 06:43:44 +00:00
Przemyslaw Czerpak
8d23393d83 2012-04-24 07:18 UTC+0200 Przemyslaw Czerpak (druzus/at/poczta.onet.pl)
* harbour/include/hbgtcore.h
    ! fixed typo in HB_GTSELF_KEYTRANS() macro.
      It should also fix problem with function keys in some GTs,
      i.e. ENTER in GTOS2 ALERT() reported by David.

  * harbour/src/rtl/filesys.c
    * use TEXT() macro
    * minor modification in fs_win_get_drive()

  * harbour/src/vm/hvm.c
    * added protection against potential memory leak if
      programmer change type of enumerated item
2012-04-24 05:18:24 +00:00
Viktor Szakats
16ad8bfcb3 2012-04-24 02:16 UTC+0200 Viktor Szakats (harbour syenar.net)
* src/rtl/filesys.c
    % fs_win_get_drive() simplified for win platform, eliminated 
      mb conversion. Code posted by Przemek.
2012-04-24 00:19:21 +00:00
Viktor Szakats
cd0cc92c3d 2012-04-23 20:31 UTC+0200 Viktor Szakats (harbour syenar.net)
* utils/hbmk2/hbmk2.prg
    + added experimental framework for -ku:<cp> option. It is
      processed by hbmk2 and HVM CP set appropriately before calling
      the embedded Harbour compiler. As discussed here:
         https://groups.google.com/d/msg/harbour-devel/a1_-DDXVVYM/CE3NspTzHV4J
      I couldn't spot or test the effect of this yet.
      Accepted <cp> values: "utf8", "cp1250", "cp852", etc...
    + added TODO to switch the internal codepage to UTF8EX.
      it should help further in handling filenames with accents.
      non-priority.

  * src/rtl/menuto.prg
    * formatting

  * contrib/hbqt/gtqtc/gtqtc.cpp
    - delete recently commented lines
2012-04-23 18:31:42 +00:00
Przemyslaw Czerpak
391ba17b95 2012-04-23 14:16 UTC+0200 Przemyslaw Czerpak (druzus/at/poczta.onet.pl)
* harbour/src/rtl/gtwin/gtwin.c
    * redirect OUTSTD() and OUTERR() to GT buffer if corresponding handles
      are redirected to console window.
2012-04-23 12:16:37 +00:00
Przemyslaw Czerpak
1bd3fa10d7 2012-04-23 13:56 UTC+0200 Przemyslaw Czerpak (druzus/at/poczta.onet.pl)
* harbour/src/rtl/filesys.c
    ! fixed typo in last commit which disabled filename translations
      in hb_fsNameConv*() functions.
2012-04-23 11:57:05 +00:00
Przemyslaw Czerpak
93d3a46d84 2012-04-20 17:52 UTC+0200 Przemyslaw Czerpak (druzus/at/poczta.onet.pl)
* harbour/include/hbdefs.h
    * moved HB_WCHAR definition from hbapicdp.h to hbdefs.h

  * harbour/include/hbapicdp.h
  * harbour/include/hbcdpreg.h
  * harbour/src/rtl/cdpapi.c
  * harbour/src/rtl/cdpapihb.c
    + added support for custom sorting redirected from HVM
    + added support for custom character indexes in strings
    + added support for custom character flags (upper, lower, alpha, digit)
    + added support for custom upper/lower conversions
    + added support for CPs using unicode character values instead of
      ASCII ones
    + added new CP functions which respects custom CP settings:
        hb_cdpUpperWC(), hb_cdpTextLen(), hb_cdpTextPos(),
        hb_cdpTextPosEx(), hb_cdpTextGetU16(), hb_cdpTextPutU16(),
        hb_cdpCharEq(), hb_cdpCharCaseEq()
    + added new conversion functions:
        hb_cdpGetUC(), hb_cdpGetWC(), hb_cdpGetU16Ctrl()
    + added macros to detect codepage parameters:
         HB_CDP_ISBINSORT() - codepage uses simple binary sorting
         HB_CDP_ISCUSTOM()  - codepage uses custom string decoding
         HB_CDP_ISCHARIDX() - codepage use character indexes instead
                              of bytes ones
         HB_CDP_ISCHARUNI() - CHR(), ASC() and similar functions operates
                              on Unicode values instead of bytes
         HB_CDP_ISUTF8()    - codepage uses UTF-8 encoding

  * harbour/include/inkey.ch
    - removed HB_INKEY_EXTENDED - it was not used in Harbour
    + added new flag HB_INKEY_EXT - it allows to used different
      event encoding system with automatic translation to
      standard Clipper values. It will be used in the future
      as base for low level GTs code. Now it's possible to
      selectively switch to the new system. New codes are
      unique and do not interacts with Clipper.
    + added HB_INKEY_ALL macro - it's similar to INKEY_ALL but
      enables also GTEVENT keys.

  * harbour/include/hbgtcore.h
  * harbour/src/rtl/hbgtcore.c
    * changed character values in internal screen buffer to unicode.
      Warning: this modification interacts with SAVESCREE()/RESTSCREEN()
               data. Now all GTs uses extended definition. If somene
               has code which needs VGA like screen buffers returned
               by SAVESCREE() then it can be forced by
                  hb_gtInfo( HB_GTI_COMPATBUFFER, .t. )
               Anyhow it will for to use only one CP in output.
    + added new GT methods which operated on HB_WCHAR values
    * modified existing methods using HB_WCHAR/HB_USHORT parameters
      to operate on HB_WCHAR values
    + added codepage conversion code directly to core code so it can
      be eliminated from low level GT drivers which do not need some
      special operations on it.
    + added support for extended inkey codes, they allow to encoded
      unicode values, mouse events with flags, keyboard events with
      modifier flags (shift,alt,ctrl,...), etc.
      Now in low level GT code only unicode key values are used but
      I plan to updated all GTs and switch to new code - it should
      resolve many small problems inheriting with Clipper inkey codes.

  * harbour/include/hbapifs.h
    * moved hb_fsNameConvU16() definition from hbapicdp.h to hbapifs.h

  * harbour/include/hbxvm.h
    - removed comment copied by mistake from GT header file

  * harbour/include/hbwinuni.h
    * changed HB_CHARDUP() and HB_CHARDUPN() macros - now they
      operate on functions which can be used without active HVM.
      In such case ANSI CP is used as source encoding.
    + added new macros: HB_OSSTRDUP() and HB_OSSTRDUP2().
      They make conversions from OS encoding to HVM one.
      They can be used without active HVM and in such case ANSI CP
      is used as destination encoding.

  * harbour/include/hbapi.h
  * harbour/src/vm/cmdarg.c
    + added new function hb_cmdargProgName()
      It returns application name with path or NULL if not set,
      caller must free returned value with hb_xfree() if not NULL.
      The string is in HVM encoding so it does not need any additional
      encodings.
    * modified hb_cmdargString() to return strings in HVM encoding.
    % some small code optimizations
    ; NOTE: parameters passed to MS-WINDOWS GUI programs which use
            WinMain() instead of main() as startup entry are translated
            to ANSICP before they can be accessed by application.
            This can be eliminated though not for console programs
            using where C compiler makes such translation to main()
            parameters.
            in all systems parameters are passed to application
            startup and init functions before programmer can set OS CP.
            This can be resolved by adding:
               INIT PROC CLIPINIT()
                  SET( _SET_CODEPAGE, <userCP> )
                  SET( _SET_OSCODEPAGE, <systemCP> )
               RETURN
            to linked code. INIT procedures called CLIPINIT() are
            executed before any other ones.

  * harbour/include/hbapi.h
  * harbour/src/vm/set.c
    + added new functions for CP converisons which can be used with
      and without active HVM:
         hb_osStrEncode(), hb_osStrEncodeN(),
         hb_osStrDecode(), hb_osStrDecode2(),
         hb_osStrU16Encode(), hb_osStrU16EncodeN(),
         hb_osStrU16Decode(), hb_osStrU16Decode2(),

  * harbour/include/hbvm.h
  * harbour/src/vm/hvm.c
    + added new function hb_vmIsReady() - it's similar to hb_vmActive()
      but it also checks if current thread has active HVM stack.
    * moved hb_cdpReleaseAll() to the end of HVM cleanup code so
      CP conversions are longer active.

  * harbour/include/hbcomp.h
  * harbour/src/compiler/cmdcheck.c
  * harbour/src/compiler/hbusage.c
  * harbour/src/common/expropt2.c
    + added new compiler switch:
         -ku  - strings in user encoding
      Now it informs compiler that strings use custom encoding so some
      optimizations which are byte oriented cannot be used.
      It's possible that in the future we will change above definition
      to sth like: "strings in UTF8 encoding" but now I would like to
      keep more general.

  * harbour/src/vm/macro.c
    * inform macrocompiler about custom CPs using own character indexes
      to disable byte oriented optimizations.

  * harbour/include/hbapigt.h
  * harbour/src/rtl/gtapi.c
  * harbour/src/rtl/inkeyapi.c
    + added HB_B_*_W macros with unicode box character definitions
    + added HB_MBUTTON_* macros
    + added new GT functions: hb_gtHostCP() and hb_gtBoxCP() which
      allows to extract CPs used in translations by GTs.
    + added new function hb_inkeyKeyString() - it converts inkey value
      to corresponding string
    + added new function hb_inkeyKeyStd() - it converts new extended
      key value to standard Clipper one.

  * harbour/include/hbapifs.h
  * harbour/src/common/hbffind.c
    * moved OS codepage translations fully to hb_fsFind*() functions.
      It fixes few problems which existed before, i.e. double CP
      conversions in MS-Windows builds and simplifies upper level code.

  * harbour/src/pp/hbpp.c
  * harbour/src/rtl/direct.c
  * harbour/src/rtl/fssize.c
  * harbour/src/rtl/file.c
  * harbour/contrib/hbct/files.c
    * eliminated not longer necessary CP conversions in code calling
      hb_fsFind*() functions.

  * harbour/src/common/hbgete.c
    * moved OS codepage translations to hb_getenv(), hb_getenv_buffer()
      and hb_setenv() functions. It fixes few problems which existed
      before, i.e. double CP conversions in MS-Windows builds and
      simplifies upper level code.

  * harbour/src/rtl/net.c
  * harbour/src/rtl/gete.c
    * eliminated not longer necessary CP conversions in code calling
      hb_getenv()/hb_setenv() functions.
    ; NOTE: additional parameters in HB_GETENV() and HB_SETENV() which
            disabled CP conversions are not longer supported.
            They were strictly platform dependent and ignored in chosen
            cases (i.e. in MS-Windows UNICODE builds we always have to
            convert strings transferred between HVM and OS. If someone
            needs old functionality for other platform then he should
            temporary disable _SET_OSCODEPAGE.

  * harbour/src/common/hbver.c
  * harbour/src/common/hbfsapi.c
  * harbour/src/rtl/fstemp.c
  * harbour/src/rtl/fslink.c
    * eliminated HB_TCHAR_*() macros

  * harbour/src/common/strwild.c
    + added supprot for custom CPs using own character indexes in:
         hb_strMatchWild(),
         hb_strMatchWildExact(),
         hb_strMatchCaseWildExact()

  * harbour/src/nortl/nortl.c
    + added new dummy function replacement for binaries which are not
      linked with HVM.

  * harbour/src/rtl/filesys.c
    ! fixed double CP conversions in MS-Windows builds of hb_fsCurDirBuff()
    * use hb_vmIsReady() instead of hb_stackId() in file name conversions.
    * use hb_cmdargProgName() in hb_fsBaseDirBuff()

  * harbour/src/rtl/philes.c
    * use hb_cmdargProgName() in HB_PROGNAME() function.

  * harbour/src/rtl/gtcgi/gtcgi.c
  * harbour/src/rtl/gtstd/gtstd.c
  * harbour/src/rtl/gtpca/gtpca.c
  * harbour/src/rtl/gtdos/gtdos.c
  * harbour/src/rtl/gtos2/gtos2.c
  * harbour/src/rtl/gtwin/gtwin.c
  * harbour/src/rtl/gtwvt/gtwvt.h
  * harbour/src/rtl/gtwvt/gtwvt.c
  * harbour/src/rtl/gttrm/gttrm.c
  * harbour/src/rtl/gtcrs/gtcrs.c
  * harbour/src/rtl/gtsln/gtsln.c
  * harbour/src/rtl/gtsln/kbsln.c
  * harbour/src/rtl/gtsln/gtsln.h
  * harbour/src/rtl/gtxwc/gtxwc.h
  * harbour/src/rtl/gtxwc/gtxwc.c
  * harbour/contrib/gtwvg/gtwvg.c
  * harbour/contrib/gtwvg/gtwvg.h
  * harbour/contrib/gtalleg/gtalleg.c
  * harbour/contrib/hbqt/gtqtc/gtqtc.cpp
  * harbour/contrib/hbqt/gtqtc/gtqtc.h
    * updated to work with new unicode GT API
      please make tests with different GTs - I'm not able to test
      all of them, i.e. I do not have any OS2 machine.

  * harbour/src/rtl/box.c
  * harbour/src/rtl/oldbox.c
  * harbour/src/rtl/scroll.c
  * harbour/src/rtl/console.c
    * updated to work with new unicode GT API and
      CPs using custom character indexes

  * harbour/src/rtl/at.c
  * harbour/src/rtl/ati.c
  * harbour/src/rtl/rat.c
  * harbour/src/rtl/len.c
  * harbour/src/rtl/transfrm.c
  * harbour/src/rtl/left.c
  * harbour/src/rtl/right.c
  * harbour/src/rtl/substr.c
  * harbour/src/rtl/stuff.c
  * harbour/src/rtl/padc.c
  * harbour/src/rtl/padl.c
  * harbour/src/rtl/padr.c
    * updated to work with CPs using custom character indexes

  * harbour/src/rtl/chrasc.c
    + added support for HB_CDP_ISCHARUNI() CPs.

  * harbour/src/rtl/mlcfunc.c
    * rewritten from scratch to work with CPs using custom character
      indexes

  * harbour/src/rtl/accept.c
    * updated to work with unicode inkey values and
      CPs using custom character indexes

  * harbour/src/rtl/strmatch.c
    % small optimization

  * harbour/src/rtl/Makefile
  + harbour/src/rtl/chruni.c
    + added new PRG functions which allows to make byte/binary and
      unicode/character operations on strings:
         HB_UCHAR( <nCode> ) -> <cText>
            return string with U+nCode character in HVM CP encoding
         HB_BCHAR( <nCode> ) -> <cText>
            return 1 byte string with <nCode> value
         HB_UCODE( <cText> ) -> <nCode>
            return unicode value of 1-st character (not byte) in given string
         HB_BCODE( <cText> ) -> <nCode>
            return value of 1-st byte in given string
         HB_ULEN( <cText> ) -> <nChars>
            return string length in characters
         HB_BLEN( <cText> ) -> <nBytes>
            return string length in bytes
         HB_UPEEK( <cText>, <n> ) -> <nCode>
            return unicode value of <n>-th character in given string
         HB_BPEEK( <cText>, <n> ) -> <nCode>
            return value of <n>-th byte in given string
         HB_UPOKE( [@]<cText>, <n>, <nVal> ) -> <cText>
            change <n>-th character in given string to unicode <nVal> one and
            return modified text
         HB_BPOKE( [@]<cText>, <n>, <nVal> ) -> <cText>
            change <n>-th byte in given string to <nVal> and return modified
            text

  * harbour/src/rtl/hbdoc.prg
  * harbour/src/rtl/memvarhb.prg
    * use HB_BCHAR() for binary string definitions

  * harbour/src/rtl/hbi18n2.prg
    * use hb_utf8CHR( 0xFEFF ) instead of hardcoded binary sting and
      HB_BLEN() instead of LEN()

  * harbour/src/rtl/inkey.c
    + added new functions:
         HB_KEYCHAR( <nKey> ) -> <cChar>
         HB_KEYSTD( <nExtKey> ) -> <nClipKey>
    ! use HB_INKEY_ALL instead of INKEY_ALL in LASTKEY()

  * harbour/src/rtl/achoice.prg
  * harbour/src/rtl/browse.prg
  * harbour/src/rtl/menuto.prg
  * harbour/src/rtl/tgetlist.prg
  * harbour/src/rtl/teditor.prg
  * harbour/src/rtl/tlabel.prg
  * harbour/src/rtl/tpopup.prg
  * harbour/src/rtl/radiobtn.prg
  * harbour/src/rtl/radiogrp.prg
  * harbour/src/rtl/wait.prg
    * updated to work with unicode inkey() values

  * harbour/src/rtl/listbox.prg
    * use box.ch macros instead of explicit CHR(...) definitions

  * harbour/src/rtl/ttopbar.prg
    * updated to work with different type of CPs

  * harbour/src/rtl/scrollbr.prg
    * formatting

  * harbour/src/rtl/mouse53.c
    * use HB_MBUTTON_* macros instead of local ones

  * harbour/src/codepage/cp_utf8.c
  + harbour/src/codepage/uc16def.c
  + harbour/src/codepage/utf8sort.c
    * replaced UTF8ASC with new CP: UTF8EX
      This CP uses character indexes instead of bytes one
      and operates on unicode characters flags.
      Tables for upper/lower conversions and upper/lower/alpha/digit
      flags were generated automatically from
         http://www.unicode.org/Public/UNIDATA/UnicodeData.txt
      It also uses custom collation rules. It's very simple one
      level sorting based on UTF8 C collation.
      If someone needs some advanced sorting rules, then it's enough
      to create copy of this cp with user custom version of UTF8_cmp()
      and UTF8_cmpi() functions, i.e. they can be redirected to some
      external library like ICU (icu-project.org).

  * harbour/contrib/hbct/ctwin.c
  * harbour/contrib/hbct/ctwin.h
  * harbour/contrib/hbct/ctwfunc.c
    * added support for new unicode GT API

  * harbour/contrib/xhb/xhbfunc.c
    * redirected HB_CMDARGARGV() to HB_PROGNAME()

  * harbour/contrib/hbnf/origin.c
    * redirected FT_ORIGIN() to HB_PROGNAME()

  * harbour/contrib/hbnf/getenvrn.c
    ! windows version of FT_GETE() fully rewritten - it should
      fix well known problems reported to the devel list. Please test.
    % small optimization for other systems

  * harbour/contrib/hbfship/exec.c
    * use hb_cmdargProgName() in EXECNAME()

  + harbour/tests/uc16_gen.prg
    + added code which generates tables with unicode character flags
      from http://www.unicode.org/Public/UNIDATA/UnicodeData.txt.
      harbour/src/codepage/uc16def.c was generated by this code.

  * harbour/tests/inkeytst.prg
  * harbour/tests/wvtext.prg
  * harbour/tests/gtkeys.prg
    * use HB_INKEY_ALL

  * harbour/include/harbour.hbx
  * harbour/include/hbcpage.hbx
  * harbour/include/hblang.hbx
    * regenerated

   ; It was quite big peace of modifications and for sure not everything
     is well tested so please make test and report problems you will find.
   ; This is basic version which introduce to HVM CPs with custom encodings.
     Some contrib code has to be updated to work correctly with it.
     I hope that developers interesting in will make necessary updates.
     I haven't touched GTWVW code at all - sorry but it needs very serious
     work to make it production ready and fix all existing problems.
   ; Special thanks to OTC - this firm sponsored adding basic UTF8 support
     to HVM.
2012-04-20 15:55:44 +00:00
Przemyslaw Czerpak
9e7977556f 2012-04-20 08:14 UTC+0200 Przemyslaw Czerpak (druzus/at/poczta.onet.pl)
* harbour/src/common/hbffind.c
    ! fixed stupid typo in my previous commit which caused
      memory and resource leak
2012-04-20 06:15:11 +00:00
Viktor Szakats
1e4b18564f 2012-04-19 12:15 UTC+0200 Viktor Szakats (harbour syenar.net)
* include/hbapicdp.h
  * src/rtl/hbregex.c
  * src/rtl/cdpapi.c
    + will now automatically enable UTF8 in PCRE searches, if
      the HVM CP is set to UTF8.
2012-04-19 10:15:59 +00:00
Viktor Szakats
b118ac7cdd 2012-04-19 02:23 UTC+0200 Viktor Szakats (harbour syenar.net)
* src/3rd/pcre/Makefile
    + enabled UTF8 support in PCRE (binary size overhead ~150KB)
    + enabled unicode properties support in PCRE (binary size overhead ~50KB)

  * src/rtl/hbregex.c
    + added commented logic to detect UTF8 support in PCRE
      and enable UTF8 mode when the HVM CP is also UTF8. Latter
      logic is missing yet and subject to review.

  * contrib/hbnetio/utils/hbnetio/netiosrv.prg
  * contrib/hbnetio/utils/hbnetio/netiocon.prg
  * contrib/hbnetio/utils/hbnetio/netiomgm.prg
  * contrib/hbrun/hbrun.prg
  * tests/ac_test.prg
  * tests/ac_test2.prg
  * tests/tstmacro.prg
  * tests/tstalias.prg
    * formatted using automatic tools
2012-04-19 00:26:16 +00:00
Mindaugas Kavaliauskas
00b85e4298 2012-04-17 16:20 UTC+0300 Mindaugas Kavaliauskas (dbtopas/at/dbtopas.lt)
* harbour/src/rtl/hbsocket.c
    ! fixed WSAEFAULT (or sometimes GPF) error by passing correct buffer 
      length to getsockopt()
2012-04-17 13:23:29 +00:00
Viktor Szakats
8586465c3a 2012-04-17 13:02 UTC+0200 Viktor Szakats (harbour syenar.net)
* src/rtl/run.c
  * src/rtl/hbrunfun.c
    * experimental: use hb_processRun() on all win targets
      (was wince targets) instead of system() from C RTL.
      QUESTION: do the same for all platforms?

  * contrib/hbwin/win_prn1.c
  * contrib/hbwin/hbwin.ch
  * contrib/hbwin/hbwin.hbx
    + WIN_ENUMFONTS() modified to work also when no HDC is passed.
    + WIN_ENUMFONTFAMILIES( [ <nCharset> ][, <cName> ] ) -> <aFonts>

  * contrib/gtwvg/wvgcuig.c
  * contrib/gtwvg/wvgcore.c
    ! fixed possible GPF in some functions if font name was not passed
2012-04-17 11:03:54 +00:00
Viktor Szakats
5906641479 2012-04-12 00:13 UTC+0200 Viktor Szakats (harbour syenar.net)
* src/rtl/fscopy.c
    * reverted last change targeting hb_fs* -> hb_file* conversion.
      Ref: https://groups.google.com/d/topic/harbour-devel/dTN7rchixh8/discussion
2012-04-11 22:14:25 +00:00
Przemyslaw Czerpak
83bf2ee7d8 2012-04-11 18:46 UTC+0200 Przemyslaw Czerpak (druzus/at/poczta.onet.pl)
* harbour/src/pp/ppcore.c
    ! fixed GPF if #pragma __*streaminclude is used with
      redirect user custom files
2012-04-11 16:46:54 +00:00
Viktor Szakats
8c26334ae9 2012-04-10 17:57 UTC+0200 Viktor Szakats (harbour syenar.net)
* src/rtl/tget.prg
    ! ignore custom picture mask characters for date var type
      for CA-Cl*pper 5.x compatibility.
         F.e.: '@ 0, 0 GET dDate PICTURE "D"'
2012-04-10 15:57:28 +00:00
Viktor Szakats
09c5c608bb 2012-04-09 21:33 UTC+0200 Viktor Szakats (harbour syenar.net)
* src/rtl/fscopy.c
    + using hb_file*() API instead of hb_fs*() API.
      Completing TODO originating from:
         https://groups.google.com/d/msg/harbour-devel/0QY0SJ8HBFU/rWbUvJXygWYJ
    ; review me. I had to add an ugly-looking hack for win, because 
      error 38 was returned when reaching the end of file successfully.
      with hb_fs*() API this didn't happen.
2012-04-09 19:33:27 +00:00
Przemyslaw Czerpak
629db6e812 2012-04-05 16:13 UTC+0200 Przemyslaw Czerpak (druzus/at/poczta.onet.pl)
* harbour/include/hbapifs.h
  * harbour/src/common/hbffind.c
    ! fixed potential freeing uninitialized handlers on some platforms
    * hide private members 

  * harbour/src/codepage/Makefile
  * harbour/include/hbcpage.hbx
  + harbour/src/codepage/cp950.c
  + harbour/src/codepage/cp_950.c
    + added new Harbour codepage "CP950". It's similar to BIG5 and
      used by MS-Windows. Please test and inform me if you can replace
      BIG5 in your applications with CP950 without any problems.

  * harbour/contrib/hbnf/hbnf.hbx
    + added FT_IDLE()
2012-04-05 14:13:51 +00:00
Przemyslaw Czerpak
09f20ca825 2012-04-04 22:43 UTC+0200 Przemyslaw Czerpak (druzus/at/poczta.onet.pl)
* harbour/src/rtl/hbsocket.c
    ! fixed problems with missing error setting in select() executed
      for asynchronous connect() (windows builds) and overwritten error
      codes in connect() and accept() (all builds). Many thanks for
      Mindaugas for locating the problem and patch.
2012-04-04 20:43:27 +00:00
Viktor Szakats
e4b80e1e05 2012-04-04 20:01 UTC+0200 Viktor Szakats (harbour syenar.net)
* include/hb_io.h
  * src/main/harbour.1
  * src/rtl/gtdos/gtdos.c
  * src/rtl/gtos2/gtos2.c
  * src/rtl/gtpca/gtpca.c
  * utils/hbmk2/hbmk2.1
  * utils/hbtest/hbtest.1
  * contrib/hbqt/hbmk2_qt.hbs
  * contrib/hbide/idemisc.prg
  * contrib/hbide/idesaveload.prg
  * contrib/hbide/ideprojmanager.prg
  * tests/sbartest.prg
  * tests/videotst.prg
  * tests/testhtml.prg
  * tests/vidtest.prg
  * tests/setkeys.prg
  * tests/mousetst.prg
  * TODO
  * NEWS
  * examples/guestbk/cgi.ch
  * examples/hscript/cgi.ch
    * "harbour project" name usage cleanup (except in license texts)
    * minor cleanups (f.e. updated project description and mailing list name in hbide)
2012-04-04 18:03:58 +00:00
Mindaugas Kavaliauskas
a8473b3fd8 2012-04-04 20:20 UTC+0300 Mindaugas Kavaliauskas (dbtopas/at/dbtopas.lt)
* src/compiler/hbopt.c
    ! fixed -w3 warning 'Variable ... is assigned but not used' in case of 
      BEGIN SEQUENCE/END SEQUENCE sentence. Ex.:
          BEGIN SEQUENCE
            nI := 1
            BREAK(NIL)
          RECOVER
            ? nI
          END SEQUENCE
2012-04-04 17:20:54 +00:00
Przemyslaw Czerpak
83a189ab01 2012-04-03 18:59 UTC+0200 Przemyslaw Czerpak (druzus/at/poczta.onet.pl)
* harbour/include/hbwinuni.h
    ! typos in previous commit

  * harbour/src/rtl/hbproces.c
    ! include hbwinuni.h
2012-04-03 16:59:21 +00:00
Przemyslaw Czerpak
e4736a3fb0 2012-04-03 18:43 UTC+0200 Przemyslaw Czerpak (druzus/at/poczta.onet.pl)
* harbour/include/hbapicdp.h
  * harbour/src/rtl/cdpapi.c
    + added new C functions:
      hb_cdpDupn(), hb_cdpStrDupU16(), hb_cdpnStrDupU16()

  * harbour/include/hbwinuni.h
    + added new macros: HB_CHARDUP() and HB_CHARDUPN()
      Warning: this macros uses HVM functions so cannot be used in
               code which is executed without active HVM i.e. in
               pure harbour compiler code (common library)

  * harbour/src/rtl/filesys.c
    * use hb_cdpStrDupU16()

  * harbour/src/rtl/hbproces.c
    ! fixed double OS codepage conversion in hb_fsProcessRun()
    * use HB_CHARDUP*() macros to respect _SET_CODEPAGE and _SET_OSCODEPAGE
      in Windows builds
2012-04-03 16:43:24 +00:00
Viktor Szakats
86c9ea9151 2012-04-03 02:28 UTC+0200 Viktor Szakats (harbour syenar.net)
* src/lang/Makefile
  + src/lang/msghuutf.c
    + added Hungarian language module in unicode (UTF-8 encoding).
2012-04-03 00:29:17 +00:00
Viktor Szakats
cc84cb85b6 2012-04-01 21:10 UTC+0200 Viktor Szakats (harbour syenar.net)
* src/common/hbverdsp.c
    * do not show '(WINANSI)' in the list of version flags.

  * utils/hbmk2/hbmk2.prg
    + add -inc to xbuild and xmate converted projects, this being 
      the default mode of operation (AFAI guess) of these tools.

  * contrib/hbct/disk.c
  * contrib/hbnf/kspeed.c
  * contrib/hbnf/peek.c
  * contrib/hbnf/proper.c
  * contrib/hbnf/ftidle.c
  * contrib/hbnf/mouse.c
  * contrib/hbnf/stod.c
  * contrib/hbnf/getvid.c
  * contrib/hbnf/getver.c
  * contrib/hbnf/getenvrn.c
  * contrib/hbnf/mkdir.c
  * contrib/hbnf/rmdir.c
    ! formatting
2012-04-01 19:11:20 +00:00
Przemyslaw Czerpak
aae6eda0c0 2012-03-30 15:53 UTC+0200 Przemyslaw Czerpak (druzus/at/poczta.onet.pl)
* harbour/include/hbwinuni.h
    ! fixed typos in HB_FSNAMECONV() definition

  * harbour/src/rtl/filesys.c
  * harbour/src/rtl/fstemp.c
  * harbour/src/rtl/fslink.c
  * harbour/src/rtl/hbcom.c
  * harbour/contrib/hbmzip/mzip.c
    ! fixed casting in recent modifications (missing const)

  * harbour/src/rtl/gtcrs/hb-charmap.def
    * formatting
2012-03-30 13:53:42 +00:00
Viktor Szakats
8ebe50a5ce 2012-03-30 12:07 UTC+0200 Viktor Szakats (harbour syenar.net)
* src/rtl/fslink.c
  * contrib/hbmzip/mzip.c
    ! fixed missing Windows macro for legacy C compilers (bcc, lcc, dmc)
      regression from 2012-03-28 20:09 UTC+0200 and 2012-03-19 12:55 UTC+0100
      reported by Grigory Filatov
2012-03-30 10:09:44 +00:00
Viktor Szakats
c41dffe86e 2012-03-29 03:45 UTC+0200 Viktor Szakats (harbour syenar.net)
* src/rtl/fstemp.c
    * hb_fsCreateTempEx(): changed to have only one return point
    ! hb_fsCreateTempEx(): do not call hb_fsNameConv() before
      calling hb_fsCreateEx(). Latter does this since a few
      commits, causing a regression here.
    ! low level hb_fsTempName() fixed to use HB_FSNAMECONV()
      instead of HB_TCHAR_*() macros. This is slightly inappropriate
      for 'prefix' parameter, but will do for now.
    ! low level hb_fsTempName() fixed to convert back result
      to _SET_OSCODEPAGE. This fixes caller hb_fsCreateTemp()
      which passes the value to hb_fsCreateEx().
    ! hb_fsTempDir(): fixed to convert result to _SET_OSCODEPAGE.
    ; NOTE: These are supposed to fix some recent and not so recent
            oddities with HB_FCREATETEMP[EX]() and HB_DIRTEMP()
            functions when used with non-ASCII chars, especially
            on Windows. Tests done only on Windows, please review
            and test, also on other platforms, non-UNICODE mode.
            Regressions are possible.
            Oddly, HB_FCREATETEMP() won't work well without properly
            set _SET_OSCODEPAGE, probably something requiring further
            fixes (and/or internal unicode support?).
    ; NOTE: As a loose rule of thumb, each Harbour high-level (.prg)
            and low-level (.c) public APIs should expect and return
            strings in _SET_CODEPAGE, while applying FSCONV transformations
            on input filenames, and converting to/from _SET_OSCODEPAGE
            when interfacing with OS-level FS APIs (_SET_OSCODEPAGE
            should be ignored if OS-level FS APIs are capable of
            handling unicode, f.e. in Windows default build mode).
            Currently, low-level code uses a mixture of different
            methods to achieve this, HB_TCHAR_* macros and equivalent
            APIs, HB_FSNAMECONV(), hb_osDecodeCP()/hb_osEncodeCP(),
            hb_fsNameConv(), Str API.

  * contrib/hbmzip/mzip.c
    + Changed to use HB_FSNAMECONV() instead of HB_TCHAR_*() macros.
    
  ; review me!
2012-03-29 01:45:42 +00:00
Przemyslaw Czerpak
e4b3fb8a71 2012-03-29 00:06 UTC+0200 Przemyslaw Czerpak (druzus/at/poczta.onet.pl)
* harbour/src/vm/itemapi.c
    % removed redundant trailing 0 setting

  * harbour/src/rtl/fslink.c
    ! fixed hb_osDecodeCP() usage

  * harbour/ChangeLog
    * marked last TOFIX as [DONE]
2012-03-28 22:07:12 +00:00
Viktor Szakats
5e6c54d918 2012-03-28 23:56 UTC+0200 Viktor Szakats (harbour syenar.net)
* src/rtl/fslink.c
    + use hb_vmUnlock()/hb_vmLock()
2012-03-28 21:57:21 +00:00